You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/12/28 10:51:21 UTC
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #374
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/374/display/redirect?page=changes>
Changes:
[mmack] [adhoc] Forbid to import guava and others from org.testcontainers.shaded
[noreply] [BEAM-13526] Kafka.IO: make DeserializerProvider a public interface
------------------------------------------
[...truncated 23.97 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/28 10:47:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640688465245630376/model
2021/12/28 10:47:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-1228100302"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640688465245630376/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640688465245630376/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-1228100302",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/28 10:47:49 Submitted job: 2021-12-28_02_47_45-7021092467857101328
2021/12/28 10:47:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-28_02_47_45-7021092467857101328?project=apache-beam-testing
2021/12/28 10:47:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-28_02_47_45-7021092467857101328
2021/12/28 10:47:49 Job state: JOB_STATE_PENDING ...
2021/12/28 10:48:19 Job still running ...
2021/12/28 10:48:49 Job still running ...
2021/12/28 10:49:19 Job still running ...
2021/12/28 10:49:49 Job still running ...
2021/12/28 10:50:19 Job still running ...
2021/12/28 10:50:49 Job still running ...
2021/12/28 10:51:19 Failed to execute job: job 2021-12-28_02_47_45-7021092467857101328 failed
panic: Failed to execute job: job 2021-12-28_02_47_45-7021092467857101328 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140f08, 0xc00019a000, 0x103011c, 0x19, 0xc0004dbe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ea
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fxlgjyy2tmois
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_LoadTests_Go_ParDo_Dataflow_Batch #502
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/502/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #501
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/501/display/redirect?page=changes>
Changes:
[zyichi] Move master readme.md to 2.40.0
[noreply] [BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink
------------------------------------------
[...truncated 23.67 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651770383486634587/****\022@4c0fa603393a93a8f8eb4224c165e662b5f9cbd7941e2635724edc308836ca95"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 17:06:24 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651770383486634587/model
2022/05/05 17:06:24 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0505150408"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.40.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770383486634587/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.40.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770383486634587/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.40.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0505150408",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/05 17:06:24 Submitted job: 2022-05-05_10_06_24-18108700625447241759
2022/05/05 17:06:24 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_10_06_24-18108700625447241759?project=apache-beam-testing
2022/05/05 17:06:24 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_10_06_24-18108700625447241759
2022/05/05 17:06:24 Job state: JOB_STATE_PENDING ...
2022/05/05 17:06:54 Job still running ...
2022/05/05 17:07:24 Job still running ...
2022/05/05 17:07:54 Job still running ...
2022/05/05 17:08:25 Job still running ...
2022/05/05 17:08:55 Job still running ...
2022/05/05 17:09:25 Failed to execute job: job 2022-05-05_10_06_24-18108700625447241759 failed
panic: Failed to execute job: job 2022-05-05_10_06_24-18108700625447241759 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1230b88, 0xc0000480c0, 0x110dc27, 0x19, 0xc0003f7e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/m5a65olshtuic
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #500
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/500/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-9245] Unable to pull datatore Entity which contains dict
[bulat.safiullin] [BEAM-14382] [Website] add banner container for with css, images, html
[Jan Lukavský] [BEAM-14196] add test verifying output watermark propagation in bundle
[Jan Lukavský] [BEAM-14196] Fix FlinkRunner mid-bundle output watermark handling
[nielm] [BEAM-14405] Fix NPE when ProjectID is not specified in a template
[bulat.safiullin] [BEAM-14382] change mobile banner img, add padding to banner section
[ahmedabualsaud] fix test decotrator typo
[noreply] Merge pull request #17440 from [BEAM-14329] Enable exponential backoff
[noreply] [BEAM-11104] Fix output forwarding issue for ProcessContinuations
[noreply] re-add testing package to pydoc (#17524)
[Heejong Lee] add test
[noreply] [BEAM-14250] Amended the workaround (#17531)
[noreply] [BEAM-11104] Fix broken split result validation (#17546)
[noreply] Fixed a SQL and screenshots in the Beam SQL blog (#17545)
[noreply] Merge pull request #17417: [BEAM-14388] Address some performance
[noreply] [BEAM-14386] [Flink] Support for scala 2.12 (#17512)
[noreply] [BEAM-14294] Worker changes to support trivial Batched DoFns (#17384)
[zyichi] Moving to 2.40.0-SNAPSHOT on master branch.
[noreply] [BEAM-14048] [CdapIO] Add ConfigWrapper for building CDAP PluginConfigs
------------------------------------------
[...truncated 23.65 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651747662312307151/****\022@e9e1d02454ea7f837e34ee38e13cfc14ca1d4efd1c7a726a677b88c346e32a4e"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 10:47:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651747662312307151/model
2022/05/05 10:47:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0505100340"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.40.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651747662312307151/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.40.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651747662312307151/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.40.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0505100340",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/05 10:47:43 Submitted job: 2022-05-05_03_47_43-17036067142711520757
2022/05/05 10:47:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_03_47_43-17036067142711520757?project=apache-beam-testing
2022/05/05 10:47:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_03_47_43-17036067142711520757
2022/05/05 10:47:43 Job state: JOB_STATE_PENDING ...
2022/05/05 10:48:13 Job still running ...
2022/05/05 10:48:43 Job still running ...
2022/05/05 10:49:13 Job still running ...
2022/05/05 10:49:43 Job still running ...
2022/05/05 10:50:14 Job still running ...
2022/05/05 10:50:44 Job still running ...
2022/05/05 10:51:14 Job still running ...
2022/05/05 10:51:44 Job still running ...
2022/05/05 10:52:18 Job still running ...
2022/05/05 10:52:49 Failed to execute job: job 2022-05-05_03_47_43-17036067142711520757 failed
panic: Failed to execute job: job 2022-05-05_03_47_43-17036067142711520757 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1230b08, 0xc0000480c0, 0x110dba7, 0x19, 0xc0003a1e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 23s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vlwvu2ormg3xg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #499
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/499/display/redirect?page=changes>
Changes:
[noreply] fix: JDBC config schema fields order
[Brian Hulette] Revert "Merge pull request #17255 from kileys/test-revert"
[Brian Hulette] BEAM-14231: bypass schema cache for
[noreply] [BEAM-13657] Follow up update version warning in __init__ (#17493)
[noreply] Merge pull request #17431 from [BEAM-14273] Add integration tests for BQ
[noreply] Merge pull request #17205 from [BEAM-14145] [Website] add carousel to
[noreply] [BEAM-14064] fix es io windowing (#17112)
[noreply] [BEAM-13670] Upgraded ipython from v7 to v8 (#17529)
[noreply] [BEAM-11104] Enable ProcessContinuation return values, add unit test
[Robert Bradshaw] [BEAM-14403] Allow Prime to be used with legacy workers.
[noreply] [BEAM-11106] Support drain in Go SDK (#17432)
[noreply] add __Init__ to inference. (#17514)
------------------------------------------
[...truncated 23.36 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651661252988456676/****\022@f3717a610c6bb62b6cd5591ab3d7497c970d18c97ba651e063b2febce3ce8fc7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/04 10:47:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651661252988456676/model
2022/05/04 10:47:33 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0428111009"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651661252988456676/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651661252988456676/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0428111009",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/04 10:47:34 Submitted job: 2022-05-04_03_47_33-4199682726259989861
2022/05/04 10:47:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-04_03_47_33-4199682726259989861?project=apache-beam-testing
2022/05/04 10:47:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-04_03_47_33-4199682726259989861
2022/05/04 10:47:34 Job state: JOB_STATE_PENDING ...
2022/05/04 10:48:04 Job still running ...
2022/05/04 10:48:34 Job still running ...
2022/05/04 10:49:04 Job still running ...
2022/05/04 10:49:34 Job still running ...
2022/05/04 10:50:04 Job still running ...
2022/05/04 10:50:34 Failed to execute job: job 2022-05-04_03_47_33-4199682726259989861 failed
panic: Failed to execute job: job 2022-05-04_03_47_33-4199682726259989861 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1230b08, 0xc0000480c0, 0x110dba7, 0x19, 0xc0003a1e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 12s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vw5wpgceb3pdk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #498
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/498/display/redirect?page=changes>
Changes:
[yathu] [BEAM-14375] Fix Java Wordcount Dataflow postcommit
[Robert Bradshaw] Allow arithmetic between deferred scalars.
[noreply] [BEAM-14390] Set user-agent when pulling licenses to avoid 403s (#17521)
[noreply] [BEAM-8688] Upgrade GCSIO to 2.2.6 (#17486)
[noreply] [BEAM-14253] patch SubscriptionPartitionLoader to work around a dataflow
[noreply] Add website link log to notify user of pre-build workflow. (#17498)
[noreply] [BEAM-11105] Add timestamp observing watermark estimation (#17476)
[noreply] Merge pull request #17487 from Adding user-agent to GCS client in Python
[noreply] [BEAM-10265] Display error message if trying to infer recursive schema
[noreply] [BEAM-12575] Upgraded ipykernel from v5 to v6 (#17526)
[noreply] [BEAM-11105] Add docs + CHANGES.md entry for Go Watermark Estimation
[noreply] Merge pull request #17380 from [BEAM-14314][BEAM-9532] Add last_updated
------------------------------------------
[...truncated 23.48 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651574861076425025/****\022@86141b7a101f3c96d2e17ccb3bc5a8e18bda844f961cc63c722af5f8a9bb47e1"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/03 10:47:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651574861076425025/model
2022/05/03 10:47:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0428111009"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651574861076425025/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651574861076425025/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0428111009",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/03 10:47:42 Submitted job: 2022-05-03_03_47_41-12950135555308445707
2022/05/03 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-03_03_47_41-12950135555308445707?project=apache-beam-testing
2022/05/03 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-03_03_47_41-12950135555308445707
2022/05/03 10:47:42 Job state: JOB_STATE_PENDING ...
2022/05/03 10:48:12 Job still running ...
2022/05/03 10:48:42 Job still running ...
2022/05/03 10:49:12 Job still running ...
2022/05/03 10:49:42 Job still running ...
2022/05/03 10:50:12 Job still running ...
2022/05/03 10:50:42 Failed to execute job: job 2022-05-03_03_47_41-12950135555308445707 failed
panic: Failed to execute job: job 2022-05-03_03_47_41-12950135555308445707 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x122d108, 0xc000120000, 0x110a694, 0x19, 0xc0007e1e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6a52ivocrf4sa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #497
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/497/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11105] Add manual watermark estimation (#17475)
------------------------------------------
[...truncated 23.55 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651488450403234267/****\022@e8ea4aca40a1633f694f0389b1527b9daed4850185ea5a21b64495c5c3536f24"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/02 10:47:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651488450403234267/model
2022/05/02 10:47:31 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0428111009"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651488450403234267/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651488450403234267/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0428111009",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/02 10:47:31 Submitted job: 2022-05-02_03_47_31-5610820124375875017
2022/05/02 10:47:31 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-02_03_47_31-5610820124375875017?project=apache-beam-testing
2022/05/02 10:47:31 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-02_03_47_31-5610820124375875017
2022/05/02 10:47:31 Job state: JOB_STATE_PENDING ...
2022/05/02 10:48:01 Job still running ...
2022/05/02 10:48:31 Job still running ...
2022/05/02 10:49:01 Job still running ...
2022/05/02 10:49:31 Job still running ...
2022/05/02 10:50:01 Job still running ...
2022/05/02 10:50:31 Job still running ...
2022/05/02 10:51:02 Job still running ...
2022/05/02 10:51:32 Job still running ...
2022/05/02 10:52:02 Job still running ...
2022/05/02 10:52:32 Failed to execute job: job 2022-05-02_03_47_31-5610820124375875017 failed
panic: Failed to execute job: job 2022-05-02_03_47_31-5610820124375875017 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209968, 0xc000120000, 0x10e7331, 0x19, 0xc000359e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 10s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/gfkec5sggil24
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #496
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/496/display/redirect?page=changes>
Changes:
[noreply] Revert "Improvement to Seed job configuration to launch against PRs
[ilion.beyst] Minor: fix typo
[noreply] Merge pull request #17422 from [BEAM-14344]: remove tracing from
------------------------------------------
[...truncated 23.45 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651402051214663602/****\022@c2cceefc4da2b7f8695607c51153e357e7bd841741b957e06509e14b47e5aa6b"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/01 10:47:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651402051214663602/model
2022/05/01 10:47:31 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0428111009"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651402051214663602/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651402051214663602/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0428111009",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/01 10:47:32 Submitted job: 2022-05-01_03_47_31-10290582976930808571
2022/05/01 10:47:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-01_03_47_31-10290582976930808571?project=apache-beam-testing
2022/05/01 10:47:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-01_03_47_31-10290582976930808571
2022/05/01 10:47:32 Job state: JOB_STATE_PENDING ...
2022/05/01 10:48:02 Job still running ...
2022/05/01 10:48:32 Job still running ...
2022/05/01 10:49:02 Job still running ...
2022/05/01 10:49:32 Job still running ...
2022/05/01 10:50:02 Job still running ...
2022/05/01 10:50:32 Failed to execute job: job 2022-05-01_03_47_31-10290582976930808571 failed
panic: Failed to execute job: job 2022-05-01_03_47_31-10290582976930808571 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208628, 0xc0000480c0, 0x10e623f, 0x19, 0xc000401e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 8s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nbipmlv7wluyk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #495
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/495/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Add element weighting parameter to BatchElements.
[Robert Bradshaw] Clearer test.
[noreply] Revert "Merge pull request #17260 from [BEAM-13229] [Website] bug side
[noreply] [BEAM-14001] Add missing test cases to existing suites in exec package
[noreply] [BEAM-14243] Add staticcheck to Github Actions Precommits (#17479)
[noreply] [BEAM-14368][BEAM-13984]Change model loading from constructor to
[noreply] [BEAM-13983] changed file name from sklearn_loader to sklearn_inference
[noreply] Add SQL in Notebooks blog post (#17481)
[noreply] Merge pull request #17404: [BEAM-13990] support date and timestamp
------------------------------------------
[...truncated 23.39 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651315651324778827/****\022@c2cceefc4da2b7f8695607c51153e357e7bd841741b957e06509e14b47e5aa6b"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/30 10:47:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651315651324778827/model
2022/04/30 10:47:31 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0428111009"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651315651324778827/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651315651324778827/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0428111009",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/30 10:47:32 Submitted job: 2022-04-30_03_47_32-3936227297926621081
2022/04/30 10:47:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-30_03_47_32-3936227297926621081?project=apache-beam-testing
2022/04/30 10:47:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-30_03_47_32-3936227297926621081
2022/04/30 10:47:32 Job state: JOB_STATE_PENDING ...
2022/04/30 10:48:02 Job still running ...
2022/04/30 10:48:32 Job still running ...
2022/04/30 10:49:02 Job still running ...
2022/04/30 10:49:32 Job still running ...
2022/04/30 10:50:02 Job still running ...
2022/04/30 10:50:32 Failed to execute job: job 2022-04-30_03_47_32-3936227297926621081 failed
panic: Failed to execute job: job 2022-04-30_03_47_32-3936227297926621081 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208628, 0xc0000480c0, 0x10e623f, 0x19, 0xc0002e5e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 8s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ngkvnxeyjk6gm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #494
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/494/display/redirect?page=changes>
Changes:
[ihr] Update Java katas to Beam 2.38
[noreply] [BEAM-14369] Fix "target/options: no such file or directory" error while
[noreply] [BEAM-14297] Enable nullable key and value arrays for xlang kafka io
[noreply] Merge pull request #17444 from [BEAM-14310] [Website] bug home
[noreply] Merge pull request #17388 from [BEAM-14311] [Website] Home Page
[noreply] [BEAM-14376] Typo in method description doc
[noreply] Add default classpath when not present (#17491)
[thiagotnunes] fix: update javadocs for ChangeStreamMetrics
[noreply] Merge pull request #17443 from [BEAM-12164]: use the end timestamp for
[noreply] Merge pull request #17260 from [BEAM-13229] [Website] bug side nav
[noreply] [BEAM-14351] Fix the template and move the announcement to the next
------------------------------------------
[...truncated 23.41 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651229252783469145/****\022@c2cceefc4da2b7f8695607c51153e357e7bd841741b957e06509e14b47e5aa6b"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/29 10:47:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651229252783469145/model
2022/04/29 10:47:33 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0428111009"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651229252783469145/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651229252783469145/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0428111009",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/29 10:47:33 Submitted job: 2022-04-29_03_47_33-6396293492012010143
2022/04/29 10:47:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-29_03_47_33-6396293492012010143?project=apache-beam-testing
2022/04/29 10:47:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-29_03_47_33-6396293492012010143
2022/04/29 10:47:34 Job state: JOB_STATE_PENDING ...
2022/04/29 10:48:04 Job still running ...
2022/04/29 10:48:34 Job still running ...
2022/04/29 10:49:04 Job still running ...
2022/04/29 10:49:34 Job still running ...
2022/04/29 10:50:04 Job still running ...
2022/04/29 10:50:34 Failed to execute job: job 2022-04-29_03_47_33-6396293492012010143 failed
panic: Failed to execute job: job 2022-04-29_03_47_33-6396293492012010143 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208628, 0xc0000480c0, 0x10e623f, 0x19, 0xc00093be78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 11s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ljdvtembfzycm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #493
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/493/display/redirect?page=changes>
Changes:
[nick.caballero] [BEAM-14363] Fixes WatermarkParameters builder for Kinesis
[noreply] [BEAM-11104] Add Checkpointing split to Go SDK (#17386)
[noreply] Merge pull request #17226 from [BEAM-14204] [Playground] Tests for
[noreply] [BEAM-13015, BEAM-14184] Address unbounded number of messages being
[noreply] Improvement to Seed job configuration to launch against PRs (#17468)
[noreply] [BEAM-13983] Small changes to sklearn runinference (#17459)
[chamikaramj] Renames ExternalPythonTransform to PythonExternalTransform
[noreply] [BEAM-14351] Inherit from Coder. (#17437)
------------------------------------------
[...truncated 23.70 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651142864387451543/****\022@c2cceefc4da2b7f8695607c51153e357e7bd841741b957e06509e14b47e5aa6b"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/28 10:47:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651142864387451543/model
2022/04/28 10:47:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0428000357"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651142864387451543/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651142864387451543/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0428000357",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/28 10:47:45 Submitted job: 2022-04-28_03_47_45-3033361489347492741
2022/04/28 10:47:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-28_03_47_45-3033361489347492741?project=apache-beam-testing
2022/04/28 10:47:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-28_03_47_45-3033361489347492741
2022/04/28 10:47:45 Job state: JOB_STATE_PENDING ...
2022/04/28 10:48:15 Job still running ...
2022/04/28 10:48:45 Job still running ...
2022/04/28 10:49:15 Job still running ...
2022/04/28 10:49:45 Job still running ...
2022/04/28 10:50:16 Job still running ...
2022/04/28 10:50:46 Job still running ...
2022/04/28 10:51:16 Job still running ...
2022/04/28 10:51:46 Job still running ...
2022/04/28 10:52:16 Job still running ...
2022/04/28 10:52:46 Job still running ...
2022/04/28 10:53:16 Failed to execute job: job 2022-04-28_03_47_45-3033361489347492741 failed
panic: Failed to execute job: job 2022-04-28_03_47_45-3033361489347492741 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208628, 0xc00019a000, 0x10e623f, 0x19, 0xc00049be78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vmdvb5sakauqo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #492
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/492/display/redirect?page=changes>
Changes:
[msbukal] FhirIO: use .search() or .searchType instead of .setResourceType()
[noreply] Remove unnecessary decorator from RunInference interface (#17463)
[noreply] [BEAM-13590] Minor deprecated warning fix (#17453)
[noreply] [BEAM-12164]: fix the negative throughput issue (#17461)
[noreply] Updated goldens for the screen diff integration tests (#17467)
[noreply] fixes copy by value error for bytes.Buffer in Error (#17469)
[noreply] Merge pull request #17354 from [BEAM-14170] - Create a test that runs
[noreply] Merge pull request #17447 from [BEAM-14357] Fix
[noreply] [BEAM-14324, BEAM-14325] Staticcheck cleanup in test files (#17393)
[noreply] BEAM-14187 Fix NPE (#17454)
[noreply] [BEAM-11105] Stateful watermark estimation (#17374)
[noreply] [BEAM-14304] implement parquetio to read/write parquet files (#17347)
------------------------------------------
[...truncated 23.63 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651056461469476256/****\022@3dcc839ba63da594f4e9c58b142cfa3519196200360cd62103562cc2a52ec88b"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/27 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651056461469476256/model
2022/04/27 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0427100346"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651056461469476256/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651056461469476256/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0427100346",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/27 10:47:42 Submitted job: 2022-04-27_03_47_42-2161596517583762663
2022/04/27 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-27_03_47_42-2161596517583762663?project=apache-beam-testing
2022/04/27 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-27_03_47_42-2161596517583762663
2022/04/27 10:47:42 Job state: JOB_STATE_PENDING ...
2022/04/27 10:48:12 Job still running ...
2022/04/27 10:48:42 Job still running ...
2022/04/27 10:49:12 Job still running ...
2022/04/27 10:49:43 Job still running ...
2022/04/27 10:50:13 Job still running ...
2022/04/27 10:50:43 Job still running ...
2022/04/27 10:51:13 Job still running ...
2022/04/27 10:51:43 Job still running ...
2022/04/27 10:52:13 Job still running ...
2022/04/27 10:52:43 Failed to execute job: job 2022-04-27_03_47_42-2161596517583762663 failed
panic: Failed to execute job: job 2022-04-27_03_47_42-2161596517583762663 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1207228, 0xc000120000, 0x10e513f, 0x19, 0xc00041de78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7vpdt2aaczszy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #491
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/491/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-14343] Allow expansion service override in ExternalPythonTransform
[Heejong Lee] update
[Heejong Lee] allows remote host
[Heejong Lee] improve compatibility with python rowcoder
[ahmedabualsaud] added tempLocation to test pipeline options
[ahmedabualsaud] using tempRoot for temp bucket location
[ahmedabualsaud] small fixes
[noreply] [BEAM-14320] Update programming-guide w/Java GroupByKey example (#17369)
[noreply] Minor: Fix release script for `current` symlinks (#17457)
[noreply] Minor: fix typo (#17452)
[noreply] Change return type for PytorchInferenceRunner (#17460)
[noreply] [BEAM-13608] JmsIO dynamic topics feature (#17163)
[Heejong Lee] add test
------------------------------------------
[...truncated 23.34 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650970064315051529/****\022@8b1ec51d47b6b7fc13e0c7048a08e85851947fc3738554d703a38d807d2bbb0f"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/26 10:47:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650970064315051529/model
2022/04/26 10:47:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0426100342"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650970064315051529/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650970064315051529/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0426100342",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/26 10:47:45 Submitted job: 2022-04-26_03_47_44-10072767241930788387
2022/04/26 10:47:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-26_03_47_44-10072767241930788387?project=apache-beam-testing
2022/04/26 10:47:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-26_03_47_44-10072767241930788387
2022/04/26 10:47:45 Job state: JOB_STATE_PENDING ...
2022/04/26 10:48:15 Job still running ...
2022/04/26 10:48:45 Job still running ...
2022/04/26 10:49:15 Job still running ...
2022/04/26 10:49:45 Job still running ...
2022/04/26 10:50:15 Job still running ...
2022/04/26 10:50:45 Job still running ...
2022/04/26 10:51:15 Job still running ...
2022/04/26 10:51:45 Job still running ...
2022/04/26 10:52:15 Job still running ...
2022/04/26 10:52:46 Failed to execute job: job 2022-04-26_03_47_44-10072767241930788387 failed
panic: Failed to execute job: job 2022-04-26_03_47_44-10072767241930788387 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202028, 0xc0000480c0, 0x10e0c08, 0x19, 0xc0003a3e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4ab3wnhdq3csm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #490
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/490/display/redirect>
Changes:
------------------------------------------
[...truncated 23.36 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650883661969753789/****\022@8b1ec51d47b6b7fc13e0c7048a08e85851947fc3738554d703a38d807d2bbb0f"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/25 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650883661969753789/model
2022/04/25 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0425100327"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650883661969753789/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650883661969753789/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0425100327",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/25 10:47:43 Submitted job: 2022-04-25_03_47_42-10970528673442651522
2022/04/25 10:47:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-25_03_47_42-10970528673442651522?project=apache-beam-testing
2022/04/25 10:47:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-25_03_47_42-10970528673442651522
2022/04/25 10:47:43 Job state: JOB_STATE_PENDING ...
2022/04/25 10:48:13 Job still running ...
2022/04/25 10:48:43 Job still running ...
2022/04/25 10:49:13 Job still running ...
2022/04/25 10:49:43 Job still running ...
2022/04/25 10:50:13 Job still running ...
2022/04/25 10:50:43 Job still running ...
2022/04/25 10:51:13 Job still running ...
2022/04/25 10:51:43 Job still running ...
2022/04/25 10:52:14 Job still running ...
2022/04/25 10:52:44 Failed to execute job: job 2022-04-25_03_47_42-10970528673442651522 failed
panic: Failed to execute job: job 2022-04-25_03_47_42-10970528673442651522 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202028, 0xc0000480c0, 0x10e0c08, 0x19, 0xc000531e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iegbsmh77ccza
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #489
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/489/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13953] added documentation for BQ Storage Write API (#17391)
------------------------------------------
[...truncated 23.40 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650797264644951015/****\022@8b1ec51d47b6b7fc13e0c7048a08e85851947fc3738554d703a38d807d2bbb0f"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/24 10:47:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650797264644951015/model
2022/04/24 10:47:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0424100328"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650797264644951015/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650797264644951015/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0424100328",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/24 10:47:45 Submitted job: 2022-04-24_03_47_45-9778240129658753894
2022/04/24 10:47:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-24_03_47_45-9778240129658753894?project=apache-beam-testing
2022/04/24 10:47:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-24_03_47_45-9778240129658753894
2022/04/24 10:47:45 Job state: JOB_STATE_PENDING ...
2022/04/24 10:48:16 Job still running ...
2022/04/24 10:48:46 Job still running ...
2022/04/24 10:49:16 Job still running ...
2022/04/24 10:49:46 Job still running ...
2022/04/24 10:50:16 Job still running ...
2022/04/24 10:50:46 Job still running ...
2022/04/24 10:51:16 Job still running ...
2022/04/24 10:51:46 Job still running ...
2022/04/24 10:52:16 Job still running ...
2022/04/24 10:52:46 Failed to execute job: job 2022-04-24_03_47_45-9778240129658753894 failed
panic: Failed to execute job: job 2022-04-24_03_47_45-9778240129658753894 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202028, 0xc000120000, 0x10e0c08, 0x19, 0xc000405e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/hfplkpxjka4lw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #488
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/488/display/redirect?page=changes>
Changes:
[Andrew Pilloud] [BEAM-14321] SQL passes Null for Null aggregates
[noreply] Create apache-hop-with-dataflow.md
[noreply] Add files via upload
[noreply] Delete website/www/site/content/en/blog/apache-hop-with-dataflow
[noreply] Add files via upload
[Andrew Pilloud] [BEAM-14348] Upgrade to ZetaSQL 2022.04.1
[Andrew Pilloud] [BEAM-13735] Enable ZetaSQL tests for Java 17
[noreply] Update apache-hop-with-dataflow.md
[noreply] Update apache-hop-with-dataflow.md
[noreply] Update apache-hop-with-dataflow.md
[danielamartinmtz] Moved up get-credentials instruction for getting the kubeconfig file
[noreply] [BEAM-13657] Add python 3.6 update to CHANGES.md (#17435)
[noreply] Merge pull request #17438: [BEAM-8127] The GCP module to declare
[noreply] Merge pull request #17428: [BEAM-14326] Make sure BigQuery daemon thread
[noreply] [BEAM-14301] Add lint:ignore to noescape() func (#17355)
[noreply] [BEAM-14286] Remove unused vars in harness package (#17392)
[noreply] [BEAM-14327] Convert Results to QueryResults directly (#17398)
[noreply] [BEAM-14302] Simplify boolean check in fn.go (#17399)
[noreply] [BEAM-13983] Sklearn Loader for RunInference (#17368)
[noreply] Update authors.yml
[noreply] [BEAM-14358] add retry to connect to testcontainer (#17449)
[noreply] [BEAM-13106] Bump flink docs to 1.14 (#17430)
------------------------------------------
[...truncated 23.38 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650710864864625679/****\022@8b1ec51d47b6b7fc13e0c7048a08e85851947fc3738554d703a38d807d2bbb0f"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/23 10:47:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650710864864625679/model
2022/04/23 10:47:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0423100340"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650710864864625679/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650710864864625679/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0423100340",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/23 10:47:46 Submitted job: 2022-04-23_03_47_45-389372086023419732
2022/04/23 10:47:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-23_03_47_45-389372086023419732?project=apache-beam-testing
2022/04/23 10:47:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-23_03_47_45-389372086023419732
2022/04/23 10:47:46 Job state: JOB_STATE_PENDING ...
2022/04/23 10:48:16 Job still running ...
2022/04/23 10:48:46 Job still running ...
2022/04/23 10:49:16 Job still running ...
2022/04/23 10:49:46 Job still running ...
2022/04/23 10:50:16 Job still running ...
2022/04/23 10:50:46 Job still running ...
2022/04/23 10:51:16 Job still running ...
2022/04/23 10:51:46 Job still running ...
2022/04/23 10:52:16 Job still running ...
2022/04/23 10:52:47 Failed to execute job: job 2022-04-23_03_47_45-389372086023419732 failed
panic: Failed to execute job: job 2022-04-23_03_47_45-389372086023419732 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202028, 0xc000120000, 0x10e0c08, 0x19, 0xc0005a9e78, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uks7j4yai6iku
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #487
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/487/display/redirect?page=changes>
Changes:
[mmack] [BEAM-14335] Spotless Spark sources
[mmack] [BEAM-14345] Force paranamer 2.8 for Spark Hadoop version tests to avoid
[noreply] BEAM-13582 Fixing broken links in the documentation (#17300)
[kamil.bregula] Revert "[BEAM-14300] Fix Java precommit failure"
[kamil.bregula] Revert "Merge pull request #17223 from [BEAM-14215] Improve argument
[noreply] [BEAM-13657] Sunset python 3.6 (#17252)
[noreply] Removes unsupported Python 3.6 from the release validation script
[noreply] [BEAM-13984] Implement RunInference for PyTorch (#17196)
[noreply] [BEAM-13945] add json type support for java bigquery connector (#17209)
[noreply] [BEAM-14346] Fix incorrect error case index in ret2() (#17425)
[noreply] [BEAM-14342] Fix wrong default buffer type in fn_runner (#17420)
[noreply] Updates opencensus-api dependency to the latest version - 0.31.0
[noreply] [BEAM-14306] Add unit testing to pane coder (#17370)
[noreply] Updated the dep and golden for screen diff integration tests (#17442)
------------------------------------------
[...truncated 23.12 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650624455403608077/****\022@aefd6c1e6a04bfe763002baa0a598f527282a3f8ea3de57ba9cb79821a6482b5"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/22 10:47:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650624455403608077/model
2022/04/22 10:47:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0422100346"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650624455403608077/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650624455403608077/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0422100346",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/22 10:47:36 Submitted job: 2022-04-22_03_47_36-10457647288496065976
2022/04/22 10:47:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-22_03_47_36-10457647288496065976?project=apache-beam-testing
2022/04/22 10:47:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-22_03_47_36-10457647288496065976
2022/04/22 10:47:36 Job state: JOB_STATE_PENDING ...
2022/04/22 10:48:06 Job still running ...
2022/04/22 10:48:36 Job still running ...
2022/04/22 10:49:06 Job still running ...
2022/04/22 10:49:36 Job still running ...
2022/04/22 10:50:06 Job still running ...
2022/04/22 10:50:37 Failed to execute job: job 2022-04-22_03_47_36-10457647288496065976 failed
panic: Failed to execute job: job 2022-04-22_03_47_36-10457647288496065976 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202068, 0xc000120000, 0x10e0c08, 0x19, 0xc0007b7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 10s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jsouvixpulvnu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #486
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/486/display/redirect?page=changes>
Changes:
[vachan] Annotating Read API tests.
[bulat.safiullin] [BEAM-14247] [Website] add image
[bulat.safiullin] [BEAM-14247] [Website] center image
[mattcasters] BEAM-1857 : CHANGES.md entry for 2.38.0
[mmack] [BEAM-14323] Improve IDE integration of Spark cross version builds
[noreply] [BEAM-14112] Fixed ReadFromBigQuery with Interactive Beam (#17306)
[noreply] Update .asf.yaml (#17409)
[noreply] [BEAM-14336] Sickbay flight delays test - dataset seems to be missing
[noreply] [BEAM-14338] Update watermark unit tests to use time.Time.Equals()
[noreply] [BEAM-14328] Tweaks to "Differences from pandas" page (#17413)
[Andrew Pilloud] [BEAM-14253] Disable broken test pending Dataflow fix
[yiru] fix: BigQuery Storage Connector trace id population missing bracket
[noreply] [BEAM-14330] Temporarily disable the clusters auto-cleanup (#17400)
[noreply] Update Beam website to release 2.38.0 (#17378)
[noreply] [BEAM-14213] Add API and construction time validation for Batched DoFns
[noreply] Minor: Update release guide regarding archive.apache.org (#17419)
[noreply] [BEAM-14017] beam_PreCommit_CommunityMetrics_Cron test failing (#17396)
------------------------------------------
[...truncated 23.18 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650538059408554225/****\022@a7876b7011e25af410135145a062d822bda28d4b687ba3d3ceb1638b43bb00ed"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/21 10:47:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650538059408554225/model
2022/04/21 10:47:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0421100400"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650538059408554225/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650538059408554225/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0421100400",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/21 10:47:40 Submitted job: 2022-04-21_03_47_40-878408285622390567
2022/04/21 10:47:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-21_03_47_40-878408285622390567?project=apache-beam-testing
2022/04/21 10:47:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-21_03_47_40-878408285622390567
2022/04/21 10:47:40 Job state: JOB_STATE_PENDING ...
2022/04/21 10:48:10 Job still running ...
2022/04/21 10:48:40 Job still running ...
2022/04/21 10:49:10 Job still running ...
2022/04/21 10:49:40 Job still running ...
2022/04/21 10:50:10 Job still running ...
2022/04/21 10:50:41 Failed to execute job: job 2022-04-21_03_47_40-878408285622390567 failed
panic: Failed to execute job: job 2022-04-21_03_47_40-878408285622390567 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1201fe8, 0xc0000480c0, 0x10e0c08, 0x19, 0xc0005b7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/oncwvzas2y7z2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #485
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/485/display/redirect?page=changes>
Changes:
[andyye333] Change func to PTransform
[noreply] Populate actual dataflow job id to bigquery write trace id (#17130)
[relax] mark static thread as a daemon thread
[noreply] [BEAM-13866] Add miscellaneous exec unit tests (#17363)
------------------------------------------
[...truncated 23.40 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650451668885130088/****\022@a7876b7011e25af410135145a062d822bda28d4b687ba3d3ceb1638b43bb00ed"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/20 10:47:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650451668885130088/model
2022/04/20 10:47:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0420100330"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650451668885130088/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650451668885130088/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0420100330",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/20 10:47:50 Submitted job: 2022-04-20_03_47_49-18390923331229798037
2022/04/20 10:47:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-20_03_47_49-18390923331229798037?project=apache-beam-testing
2022/04/20 10:47:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-20_03_47_49-18390923331229798037
2022/04/20 10:47:50 Job state: JOB_STATE_PENDING ...
2022/04/20 10:48:20 Job still running ...
2022/04/20 10:48:50 Job still running ...
2022/04/20 10:49:20 Job still running ...
2022/04/20 10:49:50 Job still running ...
2022/04/20 10:50:20 Job still running ...
2022/04/20 10:50:50 Job still running ...
2022/04/20 10:51:20 Job still running ...
2022/04/20 10:51:50 Job still running ...
2022/04/20 10:52:20 Job still running ...
2022/04/20 10:52:50 Job still running ...
2022/04/20 10:53:20 Failed to execute job: job 2022-04-20_03_47_49-18390923331229798037 failed
panic: Failed to execute job: job 2022-04-20_03_47_49-18390923331229798037 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1201fe8, 0xc000120000, 0x10e0c08, 0x19, 0xc00044fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kyiefxlewk3vi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #484
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/484/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-14251] add output_coder_override to ExpansionRequest
[Heejong Lee] remove null
[rarokni] [BEAM-14307] Fix Slow Side input pattern bug in sample
[Heejong Lee] better error msg
[Heejong Lee] update from comments
[noreply] [BEAM-14316] Introducing KafkaIO.Read implementation compatibility
[noreply] [BEAM-14290] Address staticcheck warnings in the reflectx package
[noreply] [BEAM-14302] Simply bools in fn.go, genx_test.go (#17356)
[noreply] Merge pull request #17382: [BEAM-12356] Close DatasetService leak as
------------------------------------------
[...truncated 23.25 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650365263937761615/****\022@a7876b7011e25af410135145a062d822bda28d4b687ba3d3ceb1638b43bb00ed"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/19 10:47:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650365263937761615/model
2022/04/19 10:47:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0419100339"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650365263937761615/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650365263937761615/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0419100339",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/19 10:47:45 Submitted job: 2022-04-19_03_47_44-3936326178396158702
2022/04/19 10:47:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-19_03_47_44-3936326178396158702?project=apache-beam-testing
2022/04/19 10:47:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-19_03_47_44-3936326178396158702
2022/04/19 10:47:45 Job state: JOB_STATE_PENDING ...
2022/04/19 10:48:15 Job still running ...
2022/04/19 10:48:45 Job still running ...
2022/04/19 10:49:15 Job still running ...
2022/04/19 10:49:45 Job still running ...
2022/04/19 10:50:15 Job still running ...
2022/04/19 10:50:45 Job still running ...
2022/04/19 10:51:16 Failed to execute job: job 2022-04-19_03_47_44-3936326178396158702 failed
panic: Failed to execute job: job 2022-04-19_03_47_44-3936326178396158702 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1201fe8, 0xc0000480c0, 0x10e0c08, 0x19, 0xc00074fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iwx3iped4v3qi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #483
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/483/display/redirect>
Changes:
------------------------------------------
[...truncated 23.27 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650278860423722649/****\022@d8109c173acb6eaae47618a3d8af6fe9f1fe14513583a430f579f3e2c74d6c63"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/18 10:47:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650278860423722649/model
2022/04/18 10:47:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0418100331"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650278860423722649/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650278860423722649/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0418100331",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/18 10:47:42 Submitted job: 2022-04-18_03_47_41-9797581625831074490
2022/04/18 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-18_03_47_41-9797581625831074490?project=apache-beam-testing
2022/04/18 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-18_03_47_41-9797581625831074490
2022/04/18 10:47:42 Job state: JOB_STATE_PENDING ...
2022/04/18 10:48:13 Job still running ...
2022/04/18 10:48:43 Job still running ...
2022/04/18 10:49:13 Job still running ...
2022/04/18 10:49:43 Job still running ...
2022/04/18 10:50:13 Job still running ...
2022/04/18 10:50:44 Job still running ...
2022/04/18 10:51:14 Failed to execute job: job 2022-04-18_03_47_41-9797581625831074490 failed
panic: Failed to execute job: job 2022-04-18_03_47_41-9797581625831074490 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1201fe8, 0xc0000480c0, 0x10e0c08, 0x19, 0xc000323e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bubsbenwmzcre
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #482
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/482/display/redirect>
Changes:
------------------------------------------
[...truncated 23.50 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650192467623022721/****\022@d8109c173acb6eaae47618a3d8af6fe9f1fe14513583a430f579f3e2c74d6c63"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/17 10:47:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650192467623022721/model
2022/04/17 10:47:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0417100336"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650192467623022721/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650192467623022721/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0417100336",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/17 10:47:48 Submitted job: 2022-04-17_03_47_48-7567514784853262916
2022/04/17 10:47:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-17_03_47_48-7567514784853262916?project=apache-beam-testing
2022/04/17 10:47:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-17_03_47_48-7567514784853262916
2022/04/17 10:47:48 Job state: JOB_STATE_PENDING ...
2022/04/17 10:48:19 Job still running ...
2022/04/17 10:48:49 Job still running ...
2022/04/17 10:49:19 Job still running ...
2022/04/17 10:49:49 Job still running ...
2022/04/17 10:50:19 Job still running ...
2022/04/17 10:50:49 Job still running ...
2022/04/17 10:51:19 Job still running ...
2022/04/17 10:51:49 Job still running ...
2022/04/17 10:52:19 Job still running ...
2022/04/17 10:52:49 Job still running ...
2022/04/17 10:53:19 Failed to execute job: job 2022-04-17_03_47_48-7567514784853262916 failed
panic: Failed to execute job: job 2022-04-17_03_47_48-7567514784853262916 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1201fe8, 0xc0000480c0, 0x10e0c08, 0x19, 0xc0006d1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ggueezge5vnzg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #481
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/481/display/redirect?page=changes>
Changes:
[pandiana] BigQueryServicesImpl: reduce number of threads spawned by
[noreply] [BEAM-13204] Fix website bug where code tabs do not appear if the
------------------------------------------
[...truncated 23.27 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650106059580913923/****\022@d8109c173acb6eaae47618a3d8af6fe9f1fe14513583a430f579f3e2c74d6c63"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/16 10:47:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650106059580913923/model
2022/04/16 10:47:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0416100333"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650106059580913923/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650106059580913923/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0416100333",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/16 10:47:40 Submitted job: 2022-04-16_03_47_40-16023496614728241825
2022/04/16 10:47:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-16_03_47_40-16023496614728241825?project=apache-beam-testing
2022/04/16 10:47:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-16_03_47_40-16023496614728241825
2022/04/16 10:47:40 Job state: JOB_STATE_PENDING ...
2022/04/16 10:48:10 Job still running ...
2022/04/16 10:48:40 Job still running ...
2022/04/16 10:49:11 Job still running ...
2022/04/16 10:49:41 Job still running ...
2022/04/16 10:50:11 Job still running ...
2022/04/16 10:50:41 Job still running ...
2022/04/16 10:51:11 Failed to execute job: job 2022-04-16_03_47_40-16023496614728241825 failed
panic: Failed to execute job: job 2022-04-16_03_47_40-16023496614728241825 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1201fe8, 0xc0000480c0, 0x10e0c08, 0x19, 0xc000561e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 45s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dhlcvywein53s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #480
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/480/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Upgrade to Gradle 7.4
[Kenneth Knowles] Remove Python module dependency on Dataflow worker
[noreply] [BEAM-13925] Dont double assign committers if author or other reviewer
[noreply] [BEAM-13739] Remove deprecated shallow clone funcs (#17362)
[noreply] [BEAM-11104] Pipe Continuation to DataSource level (#17334)
[noreply] [BEAM-11105] Basic Watermark Estimation (Wall Clock Observing) (#17267)
[noreply] Respect output coder for TextIO. (#17367)
[noreply] Merge pull request #17200 from [BEAM-12164]: fix the autoscaling backlog
[noreply] [BEAM-17035] Call python3 directly when it is available. (#17366)
[noreply] Merge pull request #17375: [BEAM-8691] Declare newer
------------------------------------------
[...truncated 23.20 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650019666150156805/****\022@d8109c173acb6eaae47618a3d8af6fe9f1fe14513583a430f579f3e2c74d6c63"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/15 10:47:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650019666150156805/model
2022/04/15 10:47:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0415100325"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650019666150156805/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650019666150156805/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0415100325",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/15 10:47:47 Submitted job: 2022-04-15_03_47_46-13813107491157928878
2022/04/15 10:47:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-15_03_47_46-13813107491157928878?project=apache-beam-testing
2022/04/15 10:47:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-15_03_47_46-13813107491157928878
2022/04/15 10:47:47 Job state: JOB_STATE_PENDING ...
2022/04/15 10:48:17 Job still running ...
2022/04/15 10:48:47 Job still running ...
2022/04/15 10:49:17 Job still running ...
2022/04/15 10:49:47 Job still running ...
2022/04/15 10:50:17 Job still running ...
2022/04/15 10:50:47 Failed to execute job: job 2022-04-15_03_47_46-13813107491157928878 failed
panic: Failed to execute job: job 2022-04-15_03_47_46-13813107491157928878 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1201fe8, 0xc0000480c0, 0x10e0c08, 0x19, 0xc000405e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fwcafhpcibs62
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #479
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/479/display/redirect?page=changes>
Changes:
[relax] handle changing schemas in Storage API sink
[noreply] Fix a couple style issues (#17361)
[noreply] [BEAM-14287] Clean up staticcheck warnings in graph/coder (#17337)
[noreply] Improvements to dataflow job service for non-Python jobs. (#17338)
[noreply] Bump minimist (#17290)
[noreply] Bump ansi-regex (#17291)
[noreply] Bump nanoid (#17292)
[noreply] Bump lodash (#17293)
[noreply] Bump url-parse (#17294)
[noreply] Bump moment (#17328)
[noreply] Merge pull request #15549 from [BEAM-11997] Changed RedisIO
------------------------------------------
[...truncated 23.18 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649933253572166810/****\022@e523f1308f603279272d85e9e512bd5384de1a69a1a46c33e53a50a7ba413c39"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/14 10:47:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649933253572166810/model
2022/04/14 10:47:34 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0414100343"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649933253572166810/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649933253572166810/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0414100343",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/14 10:47:34 Submitted job: 2022-04-14_03_47_34-1853529673159389333
2022/04/14 10:47:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-14_03_47_34-1853529673159389333?project=apache-beam-testing
2022/04/14 10:47:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-14_03_47_34-1853529673159389333
2022/04/14 10:47:34 Job state: JOB_STATE_PENDING ...
2022/04/14 10:48:04 Job still running ...
2022/04/14 10:48:34 Job still running ...
2022/04/14 10:49:05 Job still running ...
2022/04/14 10:49:35 Job still running ...
2022/04/14 10:50:05 Job still running ...
2022/04/14 10:50:35 Job still running ...
2022/04/14 10:51:05 Failed to execute job: job 2022-04-14_03_47_34-1853529673159389333 failed
panic: Failed to execute job: job 2022-04-14_03_47_34-1853529673159389333 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fd988, 0xc000120000, 0x10dcd10, 0x19, 0xc000621e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/w2lfoygmh2tu6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #478
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/478/display/redirect?page=changes>
Changes:
[Valentyn Tymofieiev] Add remaining Dataflow test suites for Python 3.9.
[Heejong Lee] [BEAM-14232] Only resolve artifacts in expanded environments for Java
[noreply] Fix test ordering issue (#17350)
[buqian] Do not pass null to MoreObjects.firstNonNull as default value
[ningkang0957] [BEAM-14288] Fixed flaky test
[noreply] [BEAM-14277] Disables Spanner change streams tests (#17346)
[noreply] [BEAM-14219] Run cleanup script to remove stale prebuilt SDK container
[Heejong Lee] [BEAM-14300] Fix Java precommit failure
[noreply] [BEAM-14116] Rollback "Chunk commit requests dynamically (#17004)"
[noreply] [BEAM-13982] A base class for run inference (#16970)
[ningkang0957] Enumerates all possible expected strings when asserting
[noreply] [BEAM-13966] Add pivot(), a non-deferred column operation on categorical
------------------------------------------
[...truncated 23.44 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649846864855698659/****\022@115f4cb7f1ceb3b6eb5bf07290abcb6f57d9327eb5c59ed6419f9af6f27a87f5"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/13 10:47:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649846864855698659/model
2022/04/13 10:47:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0413100329"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649846864855698659/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649846864855698659/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0413100329",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/13 10:47:45 Submitted job: 2022-04-13_03_47_45-11851043711985905658
2022/04/13 10:47:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-13_03_47_45-11851043711985905658?project=apache-beam-testing
2022/04/13 10:47:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-13_03_47_45-11851043711985905658
2022/04/13 10:47:45 Job state: JOB_STATE_PENDING ...
2022/04/13 10:48:16 Job still running ...
2022/04/13 10:48:46 Job still running ...
2022/04/13 10:49:16 Job still running ...
2022/04/13 10:49:46 Job still running ...
2022/04/13 10:50:16 Job still running ...
2022/04/13 10:50:46 Job still running ...
2022/04/13 10:51:16 Job still running ...
2022/04/13 10:51:46 Job still running ...
2022/04/13 10:52:16 Job still running ...
2022/04/13 10:52:46 Job still running ...
2022/04/13 10:53:16 Failed to execute job: job 2022-04-13_03_47_45-11851043711985905658 failed
panic: Failed to execute job: job 2022-04-13_03_47_45-11851043711985905658 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fd988, 0xc0000480c0, 0x10dcd10, 0x19, 0xc0008c1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/cw2dducr3lnbu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #477
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/477/display/redirect?page=changes>
Changes:
[kamil.bregula] [BEAM-14215] Improve argument validation in SnowflakeIO
[benjamin.gonzalez] [BEAM-14013] Add PreCommit Kotlin examples Jenkins Job
[Andrew Pilloud] [BEAM-13151] Support multiple layers of AutoValue nesting
[Heejong Lee] [BEAM-14233] Merge requirements from expanded response for Java External
[benjamin.gonzalez] [BEAM-14013] Add spark, direct, flink runners as triggers for Kotlin
[noreply] [BEAM-13898] Add tests to the pubsubx package. (#17324)
[noreply] [BEAM-14285] Clean up Staticcheck Warnings in io packages (#17336)
[noreply] [BEAM-14187] Fix concurrency issue in IsmReaderImpl (#17201)
[noreply] [BEAM-14288] Skip flaking test
[noreply] Simplify specifying additional dependencies in Go SDK in XLang IOs
[noreply] [BEAM-14240] Clean staticcheck warnings in runner packages (#17340)
[Daniel Oliveira] [BEAM-13538] Workaround to fix go-licenses crash.
------------------------------------------
[...truncated 23.20 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649760461927948166/****\022@115f4cb7f1ceb3b6eb5bf07290abcb6f57d9327eb5c59ed6419f9af6f27a87f5"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/12 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649760461927948166/model
2022/04/12 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0412100346"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649760461927948166/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649760461927948166/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0412100346",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/12 10:47:43 Submitted job: 2022-04-12_03_47_42-14523990295347002406
2022/04/12 10:47:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-12_03_47_42-14523990295347002406?project=apache-beam-testing
2022/04/12 10:47:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-12_03_47_42-14523990295347002406
2022/04/12 10:47:43 Job state: JOB_STATE_PENDING ...
2022/04/12 10:48:13 Job still running ...
2022/04/12 10:48:43 Job still running ...
2022/04/12 10:49:13 Job still running ...
2022/04/12 10:49:43 Job still running ...
2022/04/12 10:50:13 Job still running ...
2022/04/12 10:50:43 Failed to execute job: job 2022-04-12_03_47_42-14523990295347002406 failed
panic: Failed to execute job: job 2022-04-12_03_47_42-14523990295347002406 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fd988, 0xc0000480c0, 0x10dcd10, 0x19, 0xc0003efe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2wbpidkjzhsfu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #476
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/476/display/redirect>
Changes:
------------------------------------------
[...truncated 23.37 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649674050653281897/****\022@cb115c8967d501ee1840f44db2ff03331f12ce4b895bc28c7d2c7616941ecced"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/11 10:47:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649674050653281897/model
2022/04/11 10:47:31 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0411100345"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649674050653281897/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649674050653281897/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0411100345",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/11 10:47:33 Submitted job: 2022-04-11_03_47_31-3031406822104150169
2022/04/11 10:47:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-11_03_47_31-3031406822104150169?project=apache-beam-testing
2022/04/11 10:47:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-11_03_47_31-3031406822104150169
2022/04/11 10:47:33 Job state: JOB_STATE_PENDING ...
2022/04/11 10:48:03 Job still running ...
2022/04/11 10:48:33 Job still running ...
2022/04/11 10:49:03 Job still running ...
2022/04/11 10:49:34 Job still running ...
2022/04/11 10:50:04 Job still running ...
2022/04/11 10:50:34 Job still running ...
2022/04/11 10:51:05 Job still running ...
2022/04/11 10:51:35 Job still running ...
2022/04/11 10:52:05 Job still running ...
2022/04/11 10:52:35 Job still running ...
2022/04/11 10:53:05 Failed to execute job: job 2022-04-11_03_47_31-3031406822104150169 failed
panic: Failed to execute job: job 2022-04-11_03_47_31-3031406822104150169 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc1c8, 0xc0000480c0, 0x10db7bc, 0x19, 0xc0005d3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/es6udexmlnft4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #475
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/475/display/redirect?page=changes>
Changes:
[chamikaramj] Re-raise exceptions swallowed in several Python I/O connectors
[noreply] Merge pull request #16928: [BEAM-11971] Re add reverted timer
------------------------------------------
[...truncated 23.17 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649587655186781867/****\022@cb115c8967d501ee1840f44db2ff03331f12ce4b895bc28c7d2c7616941ecced"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/10 10:47:35 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649587655186781867/model
2022/04/10 10:47:35 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0410100346"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649587655186781867/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649587655186781867/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0410100346",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/10 10:47:38 Submitted job: 2022-04-10_03_47_35-2778978574323551683
2022/04/10 10:47:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-10_03_47_35-2778978574323551683?project=apache-beam-testing
2022/04/10 10:47:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-10_03_47_35-2778978574323551683
2022/04/10 10:47:39 Job state: JOB_STATE_PENDING ...
2022/04/10 10:48:09 Job still running ...
2022/04/10 10:48:39 Job still running ...
2022/04/10 10:49:09 Job still running ...
2022/04/10 10:49:39 Job still running ...
2022/04/10 10:50:09 Job still running ...
2022/04/10 10:50:39 Job still running ...
2022/04/10 10:51:09 Failed to execute job: job 2022-04-10_03_47_35-2778978574323551683 failed
panic: Failed to execute job: job 2022-04-10_03_47_35-2778978574323551683 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc1c8, 0xc0000480c0, 0x10db7bc, 0x19, 0xc000345e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/okzutcnrr5uvc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #474
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/474/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] [BEAM-11714] Change spotBugs jenkins config
[Robert Bradshaw] Cleanup docs on Shared.
[Kyle Weaver] Nit: correct description for precommit cron jobs.
[benjamin.gonzalez] [BEAM-11714] Add dummy class for testing
[benjamin.gonzalez] [BEAM-11714] Remove dummy class used for testing
[benjamin.gonzalez] [BEAM-11714] Spotbugs print toJenkins UI precommit_Java17
[noreply] [BEAM-13767] Remove eclipse plugin as it generates a lot of unused tasks
[noreply] [BEAM-10708] Updated beam_sql error message (#17314)
[noreply] [BEAM-14281] add as_deterministic_coder to nullable coder (#17322)
[noreply] Improvements to Beam/Spark quickstart. (#17129)
[chamikaramj] Disable BigQueryIOStorageWriteIT for Runner v2 test suite
------------------------------------------
[...truncated 23.30 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649501268299299957/****\022@cb115c8967d501ee1840f44db2ff03331f12ce4b895bc28c7d2c7616941ecced"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/09 10:47:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649501268299299957/model
2022/04/09 10:47:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0409100336"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649501268299299957/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649501268299299957/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0409100336",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/09 10:47:49 Submitted job: 2022-04-09_03_47_49-9292707312101815557
2022/04/09 10:47:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-09_03_47_49-9292707312101815557?project=apache-beam-testing
2022/04/09 10:47:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-09_03_47_49-9292707312101815557
2022/04/09 10:47:49 Job state: JOB_STATE_PENDING ...
2022/04/09 10:48:19 Job still running ...
2022/04/09 10:48:49 Job still running ...
2022/04/09 10:49:19 Job still running ...
2022/04/09 10:49:49 Job still running ...
2022/04/09 10:50:19 Job still running ...
2022/04/09 10:50:50 Job still running ...
2022/04/09 10:51:20 Failed to execute job: job 2022-04-09_03_47_49-9292707312101815557 failed
panic: Failed to execute job: job 2022-04-09_03_47_49-9292707312101815557 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc1c8, 0xc000120000, 0x10db7bc, 0x19, 0xc00040be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 56s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/c6ibsvmrhha4u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #473
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/473/display/redirect?page=changes>
Changes:
[johnjcasey] [BEAM-10529] add java and generic components of nullable xlang tests
[johnjcasey] [BEAM-10529] fix test case
[johnjcasey] [BEAM-10529] add coders and typehints to support nullable xlang coders
[johnjcasey] [BEAM-10529] update external builder to support nullable coder
[johnjcasey] [BEAM-10529] clean up coders.py
[johnjcasey] [BEAM-10529] add coder translation test
[johnjcasey] [BEAM-10529] add additional check to typecoder to not accidentally
[johnjcasey] [BEAM-10529] add test to retrieve nullable coder from typehint
[johnjcasey] [BEAM-10529] run spotless
[johnjcasey] [BEAM-10529] add go nullable coder
[johnjcasey] [BEAM-10529] cleanup extra println
[johnjcasey] [BEAM-10529] improve comments, clean up python
[bulat.safiullin] [BEAM-13992] [Website] update Contribute/Code Contribution Guide page
[bulat.safiullin] [BEAM-13992] [Website] change text, transfer tag a
[bulat.safiullin] [BEAM-13992] [Website] change code tags
[bulat.safiullin] [BEAM-13992] [Website] change text
[bulat.safiullin] [BEAM-13992] [Website] change text and links, add empty lines
[bulat.safiullin] [BEAM-13991] [Website] change links, add contribute file
[bulat.safiullin] [BEAM-13991] [Website] add content, add styles
[bulat.safiullin] [BEAM-13991] [Website] add images, add styles, delete spaces
[bulat.safiullin] [BEAM-13991] [Website] change url and aliases, delete bullet points
[bulat.safiullin] [BEAM-13991] [Website] add empty line
[bulat.safiullin] [BEAM-13992] [Website] change links, change text
[bulat.safiullin] [BEAM-13992] [Website] change links, add text, add dots
[bulat.safiullin] [BEAM-13992] [Website] change links, change text
[bulat.safiullin] [BEAM-13991] [Website] change styles, change quotes
[bulat.safiullin] [BEAM-13991] [Website] change link color
[bulat.safiullin] [BEAM-13992] [Website] change text, delete whitespace
[bulat.safiullin] [BEAM-13991] [Website] change text
[bulat.safiullin] [BEAM-13992] [Website] update text
[bulat.safiullin] [BEAM-13991] [Website] added changes from PR 13992, changed get-starting
[shivrajw] [BEAM-14236] Parquet IO support for list to conform with Apache Parquet
[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -
[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -
[mmack] [BEAM-14104] Support shard aware aggregation in Kinesis writer.
[noreply] [BEAM-13015] Lookup the container for the step once when registering
[noreply] [BEAM-14175] Log read loop abort at debug rather than error (#17183)
[noreply] [BEAM-11745] Fix author list rendering (#17308)
[noreply] [BEAM-14144] Record JFR profiles when GC thrashing is detected (#17151)
[noreply] Factors enable_prime flag in when checking use_unified_worker conditions
[noreply] [BEAM-11104] Add ProcessContinuation type to Go SDK (#17265)
[noreply] BEAM-13939: Restructure Protos to fix namespace conflicts (#16961)
[noreply] [BEAM-14270] Mark {Snowflake/BigQuery}Services as @Internal (#17309)
[noreply] [BEAM-13901] Add unit tests for graphx/cogbk.go
[noreply] [BEAM-14259, BEAM-14266] Remove unused function, replace use of ptypes
[noreply] [BEAM-14274] Fix staticcheck warnings in pipelinex (#17311)
[noreply] [BEAM-13857] Switched Go IT script to using Go flags for expansion
[noreply] Update python beam-master container image. (#17313)
------------------------------------------
[...truncated 23.43 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649414867685067948/****\022@cb115c8967d501ee1840f44db2ff03331f12ce4b895bc28c7d2c7616941ecced"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/08 10:47:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649414867685067948/model
2022/04/08 10:47:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0408100339"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649414867685067948/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649414867685067948/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0408100339",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/08 10:47:49 Submitted job: 2022-04-08_03_47_48-17005100406764100815
2022/04/08 10:47:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-08_03_47_48-17005100406764100815?project=apache-beam-testing
2022/04/08 10:47:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-08_03_47_48-17005100406764100815
2022/04/08 10:47:49 Job state: JOB_STATE_PENDING ...
2022/04/08 10:48:19 Job still running ...
2022/04/08 10:48:49 Job still running ...
2022/04/08 10:49:19 Job still running ...
2022/04/08 10:49:49 Job still running ...
2022/04/08 10:50:19 Job still running ...
2022/04/08 10:50:49 Job still running ...
2022/04/08 10:51:19 Job still running ...
2022/04/08 10:51:49 Job still running ...
2022/04/08 10:52:19 Job still running ...
2022/04/08 10:52:49 Job still running ...
2022/04/08 10:53:19 Failed to execute job: job 2022-04-08_03_47_48-17005100406764100815 failed
panic: Failed to execute job: job 2022-04-08_03_47_48-17005100406764100815 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc1c8, 0xc000120000, 0x10db7bc, 0x19, 0xc0004d3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/bb7qkimisdre4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #472
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/472/display/redirect?page=changes>
Changes:
[noreply] Avoid pr-bot state desync (#17299)
[noreply] [BEAM-14259] Clean up staticcheck warnings in the exec package (#17285)
[noreply] Minor: Prefer registered schema in SQL docs (#17298)
[Kyle Weaver] [BEAM-14262] Update plugins for Dockerized Jenkins.
[Kyle Weaver] Add ansicolor and ws-cleanup plugins.
[noreply] [Playground] add meta tags (#17207)
[noreply] fixes golint and deprecated issues in recent Go SDK import (#17304)
[noreply] [BEAM-14266] Replace deprecated ptypes package uses (#17302)
[noreply] [BEAM-11936] Fix rawtypes warnings in SnowflakeIO (#17257)
[noreply] Merge pull request #17262: [BEAM-14244] Use the supplied output
------------------------------------------
[...truncated 23.55 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649328481564908778/****\022@3501b96c7f53b93376d4019911ea61c442c3612b88db1a762b5ea7226c332d1f"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/07 10:48:02 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649328481564908778/model
2022/04/07 10:48:02 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0407100348"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649328481564908778/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649328481564908778/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0407100348",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/07 10:48:02 Submitted job: 2022-04-07_03_48_02-4864750640590489844
2022/04/07 10:48:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-07_03_48_02-4864750640590489844?project=apache-beam-testing
2022/04/07 10:48:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-07_03_48_02-4864750640590489844
2022/04/07 10:48:02 Job state: JOB_STATE_PENDING ...
2022/04/07 10:48:33 Job still running ...
2022/04/07 10:49:03 Job still running ...
2022/04/07 10:49:33 Job still running ...
2022/04/07 10:50:03 Job still running ...
2022/04/07 10:50:33 Job still running ...
2022/04/07 10:51:03 Job still running ...
2022/04/07 10:51:33 Job still running ...
2022/04/07 10:52:03 Job still running ...
2022/04/07 10:52:33 Job still running ...
2022/04/07 10:53:03 Job still running ...
2022/04/07 10:53:33 Job still running ...
2022/04/07 10:54:03 Failed to execute job: job 2022-04-07_03_48_02-4864750640590489844 failed
panic: Failed to execute job: job 2022-04-07_03_48_02-4864750640590489844 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11f7c28, 0xc0000480c0, 0x10d790f, 0x19, 0xc0005e1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2zjms2sj7ic6w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #471
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/471/display/redirect?page=changes>
Changes:
[bingyeli] update query
[Robert Bradshaw] [BEAM-14250] Fix coder registration for types defined in __main__.
[johnjcasey] [BEAM-14256] update SpEL dependency to 5.3.18.RELEASE
[johnjcasey] [BEAM-14256] remove .RELEASE
[dannymccormick] Fix dependency issue causing failures
[Kyle Weaver] [BEAM-9649] Add region option to Mongo Dataflow test.
[noreply] Allow get_coder(None).
[noreply] [BEAM-13015] Disable retries for fnapi grpc channels which otherwise
[noreply] [BEAM-13952] Sickbay
[noreply] BEAM-14235 parquetio module does not parse PEP-440 compliant Pyarrow
[noreply] [Website] Contribution guide page indent bug fix (#17287)
[noreply] [BEAM-10976] Document go sdk bundle finalization (#17048)
[noreply] [BEAM-13829] Expose status API from Go SDK Harness (#16957)
------------------------------------------
[...truncated 23.16 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649242053765725866/****\022@4977914e0be0c563c55aefa9a1c0cd6250d6f31554813843fedb11edd26fb72e"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/06 10:47:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649242053765725866/model
2022/04/06 10:47:34 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0406100348"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649242053765725866/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649242053765725866/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0406100348",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/06 10:47:36 Submitted job: 2022-04-06_03_47_34-4010359969895266647
2022/04/06 10:47:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-06_03_47_34-4010359969895266647?project=apache-beam-testing
2022/04/06 10:47:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-06_03_47_34-4010359969895266647
2022/04/06 10:47:36 Job state: JOB_STATE_PENDING ...
2022/04/06 10:48:06 Job still running ...
2022/04/06 10:48:37 Job still running ...
2022/04/06 10:49:07 Job still running ...
2022/04/06 10:49:37 Job still running ...
2022/04/06 10:50:07 Job still running ...
2022/04/06 10:50:37 Job still running ...
2022/04/06 10:51:07 Failed to execute job: job 2022-04-06_03_47_34-4010359969895266647 failed
panic: Failed to execute job: job 2022-04-06_03_47_34-4010359969895266647 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11f7bc8, 0xc000120000, 0x10d790f, 0x19, 0xc00034be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 43s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/y37usxjqteigw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #470
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/470/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] [BEAM-8970] Add docs to run wordcount example on portable Spark Runner
[Kiley Sok] Update python container version
[benjamin.gonzalez] [BEAM-8970] Add period to end of sentence
[Kyle Weaver] Add self-descriptive message for expected errors.
[noreply] Add --dataflowServiceOptions=enable_prime to useUnifiedWorker conditions
[noreply] [BEAM-10529] nullable xlang coder (#16923)
[noreply] Fix go fmt break in core/typex/special.go (#17266)
[noreply] [BEAM-5436] Add doc page on Go cross compilation. (#17256)
[noreply] Pr-bot Don't count all reviews as approvals (#17269)
[noreply] Fix postcommits (#17263)
[noreply] [BEAM-14241] Address staticcheck warnings in boot.go (#17264)
[noreply] [BEAM-14157] GrpcWindmillServer: Use stream specific boolean to do
[noreply] [BEAM-10582] Allow (and test) pyarrow 7 (#17229)
[noreply] [BEAM-13519] Solve race issues when the server responds with an error
------------------------------------------
[...truncated 23.32 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649155673904258817/****\022@302550c215360ce41773e35f11a8acec792c5b150a02e60d04c651509d257dc6"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/05 10:47:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649155673904258817/model
2022/04/05 10:47:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0405100348"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649155673904258817/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649155673904258817/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0405100348",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/05 10:47:55 Submitted job: 2022-04-05_03_47_54-6314221294497975601
2022/04/05 10:47:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-05_03_47_54-6314221294497975601?project=apache-beam-testing
2022/04/05 10:47:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-05_03_47_54-6314221294497975601
2022/04/05 10:47:55 Job state: JOB_STATE_PENDING ...
2022/04/05 10:48:25 Job still running ...
2022/04/05 10:48:55 Job still running ...
2022/04/05 10:49:25 Job still running ...
2022/04/05 10:49:55 Job still running ...
2022/04/05 10:50:25 Job still running ...
2022/04/05 10:50:55 Job still running ...
2022/04/05 10:51:25 Failed to execute job: job 2022-04-05_03_47_54-6314221294497975601 failed
panic: Failed to execute job: job 2022-04-05_03_47_54-6314221294497975601 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11566e8, 0xc0000480c0, 0x10437d5, 0x19, 0xc0003afe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/e7fvra65snqkm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #469
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/469/display/redirect>
Changes:
------------------------------------------
[...truncated 23.20 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649069259841578374/****\022@4e7ba76d1306a9b566add1407c0ac34cfe70247da82cc14ffc765f4c70be5a8d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/04 10:47:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649069259841578374/model
2022/04/04 10:47:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0404100336"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649069259841578374/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649069259841578374/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0404100336",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/04 10:47:41 Submitted job: 2022-04-04_03_47_40-6989619083260164132
2022/04/04 10:47:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-04_03_47_40-6989619083260164132?project=apache-beam-testing
2022/04/04 10:47:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-04_03_47_40-6989619083260164132
2022/04/04 10:47:41 Job state: JOB_STATE_PENDING ...
2022/04/04 10:48:11 Job still running ...
2022/04/04 10:48:41 Job still running ...
2022/04/04 10:49:11 Job still running ...
2022/04/04 10:49:41 Job still running ...
2022/04/04 10:50:11 Job still running ...
2022/04/04 10:50:41 Job still running ...
2022/04/04 10:51:11 Failed to execute job: job 2022-04-04_03_47_40-6989619083260164132 failed
panic: Failed to execute job: job 2022-04-04_03_47_40-6989619083260164132 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11551e8, 0xc0000480c0, 0x1042450, 0x19, 0xc000415e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4ju4s42qbjzwu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #468
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/468/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14143] Simplifies the ExternalPythonTransform API (#17101)
------------------------------------------
[...truncated 23.29 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648982850440031921/****\022@4e7ba76d1306a9b566add1407c0ac34cfe70247da82cc14ffc765f4c70be5a8d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/03 10:47:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648982850440031921/model
2022/04/03 10:47:31 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0403100357"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648982850440031921/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648982850440031921/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0403100357",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/03 10:47:31 Submitted job: 2022-04-03_03_47_31-2106534014073929457
2022/04/03 10:47:31 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-03_03_47_31-2106534014073929457?project=apache-beam-testing
2022/04/03 10:47:31 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-03_03_47_31-2106534014073929457
2022/04/03 10:47:31 Job state: JOB_STATE_PENDING ...
2022/04/03 10:48:01 Job still running ...
2022/04/03 10:48:31 Job still running ...
2022/04/03 10:49:01 Job still running ...
2022/04/03 10:49:31 Job still running ...
2022/04/03 10:50:01 Job still running ...
2022/04/03 10:50:31 Job still running ...
2022/04/03 10:51:01 Job still running ...
2022/04/03 10:51:31 Job still running ...
2022/04/03 10:52:01 Job still running ...
2022/04/03 10:52:31 Job still running ...
2022/04/03 10:53:02 Failed to execute job: job 2022-04-03_03_47_31-2106534014073929457 failed
panic: Failed to execute job: job 2022-04-03_03_47_31-2106534014073929457 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11551e8, 0xc000120000, 0x1042450, 0x19, 0xc00040fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 37s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ypomwfoavhojo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #467
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/467/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-14133] Fix potential NPE in BigQueryServicesImpl.getErrorInfo
[Robert Bradshaw] Revert "Revert "[BEAM-14038] Auto-startup for Python expansion service.
[Robert Bradshaw] Skip failing test for now.
[Kyle Weaver] [BEAM-14225] load balance jenkins jobs
[noreply] [BEAM-14153] Reshuffled Row Coder PCollection used as Side Input cause
[noreply] delint go sdk (#17247)
[Heejong Lee] add test
[noreply] Merge pull request #16841 from [BEAM-8823] Make FnApiRunner work by
[noreply] [BEAM-14192] Update legacy container version (#17210)
[noreply] Fix mishandling of API with BQIO (#17211)
[noreply] [BEAM-14221] Update documentation with Flink on Dataproc features
[Kiley Sok] Revert "[BEAM-14190] Python sends dataflow schema field"
------------------------------------------
[...truncated 23.15 KB...]
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648896480021547507/****\022@4e7ba76d1306a9b566add1407c0ac34cfe70247da82cc14ffc765f4c70be5a8d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/02 10:48:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648896480021547507/model
2022/04/02 10:48:00 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0402100340"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648896480021547507/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648896480021547507/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0402100340",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/02 10:48:01 Submitted job: 2022-04-02_03_48_00-8639819650068873224
2022/04/02 10:48:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-02_03_48_00-8639819650068873224?project=apache-beam-testing
2022/04/02 10:48:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-02_03_48_00-8639819650068873224
2022/04/02 10:48:01 Job state: JOB_STATE_PENDING ...
2022/04/02 10:48:31 Job still running ...
2022/04/02 10:49:01 Job still running ...
2022/04/02 10:49:31 Job still running ...
2022/04/02 10:50:01 Job still running ...
2022/04/02 10:50:31 Job still running ...
2022/04/02 10:51:01 Failed to execute job: job 2022-04-02_03_48_00-8639819650068873224 failed
panic: Failed to execute job: job 2022-04-02_03_48_00-8639819650068873224 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11551e8, 0xc000120000, 0x1042450, 0x19, 0xc00045be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 26s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/n5maiwy6mmkjo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #466
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/466/display/redirect?page=changes>
Changes:
[bulat.safiullin] [BEAM-14164] [Website] change styles
[Andrew Pilloud] [BEAM-14190] Python sends dataflow schema field
[noreply] [BEAM-14179] Fix possibly null value
[noreply] [BEAM-12815] Try to fix flaky Flink Post Commit (#17227)
[noreply] Add a portable job server that proxies the Dataflow backend. (#17189)
[noreply] [BEAM-14130] Implement JupyterLab extension for managing Dataproc
[Andrew Pilloud] [BEAM-13741] Remove forced calcite dependency from BaseBeamTable
[noreply] [BEAM-13951] Update release guide with pointers on updating
------------------------------------------
[...truncated 23.41 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648810064852820880/****\022@244b2e59d4b38e3c548535f574357322896432f000b90f5f16721513d46a79dd"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/01 10:47:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648810064852820880/model
2022/04/01 10:47:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0401100333"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648810064852820880/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648810064852820880/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0401100333",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/01 10:47:46 Submitted job: 2022-04-01_03_47_45-2676894204792599999
2022/04/01 10:47:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-01_03_47_45-2676894204792599999?project=apache-beam-testing
2022/04/01 10:47:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-01_03_47_45-2676894204792599999
2022/04/01 10:47:46 Job state: JOB_STATE_PENDING ...
2022/04/01 10:48:16 Job still running ...
2022/04/01 10:48:46 Job still running ...
2022/04/01 10:49:16 Job still running ...
2022/04/01 10:49:46 Job still running ...
2022/04/01 10:50:16 Job still running ...
2022/04/01 10:50:46 Job still running ...
2022/04/01 10:51:16 Job still running ...
2022/04/01 10:51:46 Job still running ...
2022/04/01 10:52:16 Job still running ...
2022/04/01 10:52:46 Job still running ...
2022/04/01 10:53:16 Failed to execute job: job 2022-04-01_03_47_45-2676894204792599999 failed
panic: Failed to execute job: job 2022-04-01_03_47_45-2676894204792599999 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11534e8, 0xc000120000, 0x1040a70, 0x19, 0xc0007afe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wrfe6nyle7m2w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #465
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/465/display/redirect?page=changes>
Changes:
[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn
[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn
[egalpin] [BEAM-14003] Adds compat for Elasticsearch 8.0.0
[egalpin] [BEAM-13136] Removes support for Elasticsearch 2.x
[noreply] Merge pull request #17149 from [BEAM-13883] [Playground] Increase test
[Kiley Sok] ignore test
[noreply] [BEAM-13948] Add unstack(), a non-deferred column operation on
[noreply] [BEAM-10976] Bundle finalization: E2E support (#17045)
------------------------------------------
[...truncated 23.22 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648723671247095155/****\022@244b2e59d4b38e3c548535f574357322896432f000b90f5f16721513d46a79dd"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/31 10:47:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648723671247095155/model
2022/03/31 10:47:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0331100332"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648723671247095155/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648723671247095155/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0331100332",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/31 10:47:52 Submitted job: 2022-03-31_03_47_51-15821977291290532093
2022/03/31 10:47:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-31_03_47_51-15821977291290532093?project=apache-beam-testing
2022/03/31 10:47:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-31_03_47_51-15821977291290532093
2022/03/31 10:47:52 Job state: JOB_STATE_PENDING ...
2022/03/31 10:48:22 Job still running ...
2022/03/31 10:48:52 Job still running ...
2022/03/31 10:49:22 Job still running ...
2022/03/31 10:49:52 Job still running ...
2022/03/31 10:50:22 Job still running ...
2022/03/31 10:50:53 Job still running ...
2022/03/31 10:51:23 Failed to execute job: job 2022-03-31_03_47_51-15821977291290532093 failed
panic: Failed to execute job: job 2022-03-31_03_47_51-15821977291290532093 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11534e8, 0xc000120000, 0x1040a70, 0x19, 0xc0007f9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7oh2kfw666stw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #464
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/464/display/redirect?page=changes>
Changes:
[vachan] Update display data to include BQ information.
[noreply] Revert "[BEAM-14084] iterable_input_value_types changed from list to
[chamikaramj] Convert URLs to local jars when constructing filesToStage
[Valentyn Tymofieiev] Ensure the removed option prebuild_sdk_container_base_image not used on
[noreply] [BEAM-13314]Revise recommendations to manage Python pipeline
[noreply] Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for
[noreply] Merge pull request #17080 from [BEAM-13880] [Playground] Increase test
[noreply] Merge pull request #17050 from [BEAM-13877] [Playground] Increase test
[noreply] [BEAM-14200] Improve SamzaJobInvoker extensibility (#17212)
[noreply] Merge pull request #17148 from [BEAM-14042] [playground] Scroll imports
[noreply] [BEAM-13918] Increase datastoreio go sdk unit test coverage (#17173)
[noreply] Merge pull request #16819: [BEAM-13806] Adding test suite for Go x-lang
------------------------------------------
[...truncated 23.35 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648637261850447812/****\022@29dadb100e39e4a1127319ad7aa94be82fb2e5181b089029abdc9f869ab51ae7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/30 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648637261850447812/model
2022/03/30 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0330100322"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648637261850447812/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648637261850447812/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0330100322",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/30 10:47:43 Submitted job: 2022-03-30_03_47_42-17821546563386863974
2022/03/30 10:47:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-30_03_47_42-17821546563386863974?project=apache-beam-testing
2022/03/30 10:47:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-30_03_47_42-17821546563386863974
2022/03/30 10:47:43 Job state: JOB_STATE_PENDING ...
2022/03/30 10:48:13 Job still running ...
2022/03/30 10:48:43 Job still running ...
2022/03/30 10:49:13 Job still running ...
2022/03/30 10:49:43 Job still running ...
2022/03/30 10:50:13 Job still running ...
2022/03/30 10:50:43 Job still running ...
2022/03/30 10:51:13 Job still running ...
2022/03/30 10:51:43 Job still running ...
2022/03/30 10:52:13 Job still running ...
2022/03/30 10:52:43 Job still running ...
2022/03/30 10:53:13 Failed to execute job: job 2022-03-30_03_47_42-17821546563386863974 failed
panic: Failed to execute job: job 2022-03-30_03_47_42-17821546563386863974 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc000120000, 0x103ddcc, 0x19, 0xc00087fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/svhkha6rugb6c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #463
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/463/display/redirect?page=changes>
Changes:
[hengfeng] feat: remove the metadata table after the pipeline finishes
[thiagotnunes] test: add test for metadata table dropping
[noreply] Minor: Add warning about pubsub client to Beam 2.36.0 blog (#17188)
[noreply] [BEAM-14177] Fix GBK re-iteration caching for portable runners. (#17184)
[noreply] Merge pull request #17187: [BEAM-14181] Make sure to evict connections
[noreply] Only reset transform.label if it is correctly assigned (#17192)
[noreply] [BEAM-12641] Use google-auth instead of oauth2client for GCP auth
[Robert Bradshaw] [BEAM-14163] Fix typo in single core per container logic.
[thiagotnunes] test: disable SpannerIO.readChangeStream test
[noreply] Merge pull request #17164 from [BEAM-14140][Playground] Fix Deploy
[noreply] Merge pull request #16855 from [BEAM-13938][Playground] Increase test
------------------------------------------
[...truncated 23.21 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648550861583571622/****\022@29dadb100e39e4a1127319ad7aa94be82fb2e5181b089029abdc9f869ab51ae7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/29 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648550861583571622/model
2022/03/29 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0329100336"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648550861583571622/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648550861583571622/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0329100336",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/29 10:47:42 Submitted job: 2022-03-29_03_47_42-17838597452175026211
2022/03/29 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-29_03_47_42-17838597452175026211?project=apache-beam-testing
2022/03/29 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-29_03_47_42-17838597452175026211
2022/03/29 10:47:42 Job state: JOB_STATE_PENDING ...
2022/03/29 10:48:12 Job still running ...
2022/03/29 10:48:42 Job still running ...
2022/03/29 10:49:12 Job still running ...
2022/03/29 10:49:42 Job still running ...
2022/03/29 10:50:13 Job still running ...
2022/03/29 10:50:43 Job still running ...
2022/03/29 10:51:13 Failed to execute job: job 2022-03-29_03_47_42-17838597452175026211 failed
panic: Failed to execute job: job 2022-03-29_03_47_42-17838597452175026211 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc000120000, 0x103ddcc, 0x19, 0xc0004b7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/lbzrranttck26
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #462
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/462/display/redirect>
Changes:
------------------------------------------
[...truncated 23.22 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648464459831978884/****\022@29dadb100e39e4a1127319ad7aa94be82fb2e5181b089029abdc9f869ab51ae7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/28 10:47:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648464459831978884/model
2022/03/28 10:47:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0328100331"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648464459831978884/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648464459831978884/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0328100331",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/28 10:47:41 Submitted job: 2022-03-28_03_47_40-4931370811420595464
2022/03/28 10:47:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-28_03_47_40-4931370811420595464?project=apache-beam-testing
2022/03/28 10:47:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-28_03_47_40-4931370811420595464
2022/03/28 10:47:41 Job state: JOB_STATE_PENDING ...
2022/03/28 10:48:11 Job still running ...
2022/03/28 10:48:41 Job still running ...
2022/03/28 10:49:11 Job still running ...
2022/03/28 10:49:41 Job still running ...
2022/03/28 10:50:11 Job still running ...
2022/03/28 10:50:41 Job still running ...
2022/03/28 10:51:11 Failed to execute job: job 2022-03-28_03_47_40-4931370811420595464 failed
panic: Failed to execute job: job 2022-03-28_03_47_40-4931370811420595464 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc000120000, 0x103ddcc, 0x19, 0xc0005f7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/lu3v5tynjrg7s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #461
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/461/display/redirect>
Changes:
------------------------------------------
[...truncated 23.25 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648378067093145921/****\022@29dadb100e39e4a1127319ad7aa94be82fb2e5181b089029abdc9f869ab51ae7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/27 10:47:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648378067093145921/model
2022/03/27 10:47:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0327100332"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648378067093145921/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648378067093145921/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0327100332",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/27 10:47:48 Submitted job: 2022-03-27_03_47_47-10873269931172942868
2022/03/27 10:47:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-27_03_47_47-10873269931172942868?project=apache-beam-testing
2022/03/27 10:47:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-27_03_47_47-10873269931172942868
2022/03/27 10:47:48 Job state: JOB_STATE_PENDING ...
2022/03/27 10:48:18 Job still running ...
2022/03/27 10:48:48 Job still running ...
2022/03/27 10:49:18 Job still running ...
2022/03/27 10:49:48 Job still running ...
2022/03/27 10:50:18 Job still running ...
2022/03/27 10:50:48 Job still running ...
2022/03/27 10:51:18 Failed to execute job: job 2022-03-27_03_47_47-10873269931172942868 failed
panic: Failed to execute job: job 2022-03-27_03_47_47-10873269931172942868 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc000120000, 0x103ddcc, 0x19, 0xc000353e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uj3cgvgqqg2g2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #460
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/460/display/redirect?page=changes>
Changes:
[ryanthompson591] iterable_input_value_types will now be an iterable, I don't anticipate
[marco.robles] [BEAM-8218] PulsarIO Connector
[benjamin.gonzalez] [BEAM-12572] Change examples jobs to run as cron jobs
[benjamin.gonzalez] [BEAM-12572] SpotlessApply
[Robert Bradshaw] [BEAM-14171] More explicit asserts in CoGBKResult.
[Robert Bradshaw] Add some comments.
[noreply] [BEAM-14160] Parse filesToStage in Java expansion service (#17167)
[chamikaramj] Mapped JOB_STATE_RESOURCE_CLEANING_UP to RESOURCE_CLEANING_UP in Python
[noreply] Explicitly import estimator from tensorflow (#17168)
------------------------------------------
[...truncated 23.22 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648291657979330489/****\022@29dadb100e39e4a1127319ad7aa94be82fb2e5181b089029abdc9f869ab51ae7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/26 10:47:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648291657979330489/model
2022/03/26 10:47:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0326100334"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648291657979330489/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648291657979330489/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0326100334",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/26 10:47:39 Submitted job: 2022-03-26_03_47_38-11502877779038567838
2022/03/26 10:47:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-26_03_47_38-11502877779038567838?project=apache-beam-testing
2022/03/26 10:47:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-26_03_47_38-11502877779038567838
2022/03/26 10:47:40 Job state: JOB_STATE_PENDING ...
2022/03/26 10:48:10 Job still running ...
2022/03/26 10:48:40 Job still running ...
2022/03/26 10:49:10 Job still running ...
2022/03/26 10:49:40 Job still running ...
2022/03/26 10:50:10 Job still running ...
2022/03/26 10:50:40 Job still running ...
2022/03/26 10:51:10 Failed to execute job: job 2022-03-26_03_47_38-11502877779038567838 failed
panic: Failed to execute job: job 2022-03-26_03_47_38-11502877779038567838 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc0000480c0, 0x103ddcc, 0x19, 0xc0003f5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/q2cm5lujbhrea
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #459
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/459/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-14139] Drop support for Flink 1.11.
[Kyle Weaver] [BEAM-14139] Remove obsolete reference to Flink 1.11.
[Kyle Weaver] [BEAM-14139] Update list of supported Flink versions.
[Kyle Weaver] [BEAM-14139] Update CHANGES.md
[noreply] [BEAM-14157] Don't call requestObserver.onNext on a closed windmill
[noreply] Minor: Make IOTypeHints a real NamedTuple (#17174)
[noreply] [BEAM-14172] Update tox.ini for pydocs (#17176)
[noreply] [BEAM-14065] Upgrade vendored bytebuddy to version 1.12.8 (#17028)
------------------------------------------
[...truncated 23.38 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648205269996009644/****\022@29dadb100e39e4a1127319ad7aa94be82fb2e5181b089029abdc9f869ab51ae7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/25 10:47:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648205269996009644/model
2022/03/25 10:47:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0325100335"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648205269996009644/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648205269996009644/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0325100335",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/25 10:47:52 Submitted job: 2022-03-25_03_47_50-18164615122193504058
2022/03/25 10:47:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-25_03_47_50-18164615122193504058?project=apache-beam-testing
2022/03/25 10:47:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-25_03_47_50-18164615122193504058
2022/03/25 10:47:52 Job state: JOB_STATE_PENDING ...
2022/03/25 10:48:22 Job still running ...
2022/03/25 10:48:52 Job still running ...
2022/03/25 10:49:23 Job still running ...
2022/03/25 10:49:53 Job still running ...
2022/03/25 10:50:23 Job still running ...
2022/03/25 10:50:53 Job still running ...
2022/03/25 10:51:23 Job still running ...
2022/03/25 10:51:53 Job still running ...
2022/03/25 10:52:23 Job still running ...
2022/03/25 10:52:53 Job still running ...
2022/03/25 10:53:23 Failed to execute job: job 2022-03-25_03_47_50-18164615122193504058 failed
panic: Failed to execute job: job 2022-03-25_03_47_50-18164615122193504058 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc0000480c0, 0x103ddcc, 0x19, 0xc000407e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3htu6s4uh53yw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #458
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/458/display/redirect?page=changes>
Changes:
[bulat.safiullin] [BEAM-13976] [Website] update homepage
[bulat.safiullin] [BEAM-13976] [Website] update homepage, add logo
[bulat.safiullin] [BEAM-13976] [Website] update text
[bulat.safiullin] [BEAM-13976] [Website] Update Community landing page
[bulat.safiullin] [BEAM-13979] [Website] Update Community/Contact us page
[bulat.safiullin] [BEAM-13979] [Website] update title
[bulat.safiullin] [BEAM-13979] [Website] delete space
[bulat.safiullin] [BEAM-13979] [Website] add Beam Playground
[bulat.safiullin] [BEAM-13976] [Website] delete Beam Playground
[bulat.safiullin] [BEAM-13976] [Website] change navbar css links rules, delete links from
[bulat.safiullin] [BEAM-13977] [Website] delete available-contact-channels on mobile
[bulat.safiullin] [BEAM-13976] [Website] change padding size between the sections
[bulat.safiullin] [BEAM-13976] [Website] change title to capital letters
[bulat.safiullin] [BEAM-13976] [Website] change title
[bulat.safiullin] [BEAM-14040] [Website] create new page, add link
[bulat.safiullin] [BEAM-13977] [Website] change title
[bulat.safiullin] [BEAM-13979] [Website] change text
[bulat.safiullin] [BEAM-13976] [Website] change text
[bulat.safiullin] [BEAM-13977] [Website] change text, add capital letters
[bulat.safiullin] [BEAM-13976] [Website] add playground sass, change text-align
[bulat.safiullin] [BEAM-14040] [Website] add io connectors table
[bulat.safiullin] [BEAM-13976] [Website] add playground section, add empty line
[bulat.safiullin] [BEAM-14040] [Website] add overflow to css, add table content
[bulat.safiullin] [BEAM-14040] [Website] change ✘ for ✔, add license, add br
[bulat.safiullin] [BEAM-14040] [Website] add empty line
[bulat.safiullin] [BEAM-14040] [Website] change td
[bulat.safiullin] [BEAM-14041] [Website] update built io transforms
[bulat.safiullin] [BEAM-14041] [Website] move connectors from Miscellaneous to Database
[bulat.safiullin] [BEAM-14040] [Website] change links color
[danielamartinmtz] Updated metrics' CronJob API to use the latest batch version.
[bulat.safiullin] [BEAM-14041] [Website] change IO from go to java
[bulat.safiullin] [BEAM-14040] [Website] change links, change specific version to current
[danielamartinmtz] Updated cluster to test in metrics-upgrade-clone in BeamMetrics_Publish
[aydar.zaynutdinov] [BEAM-13976][Website]
[aydar.zaynutdinov] [BEAM-14040][Website]
[aydar.zaynutdinov] [BEAM-14041][Website]
[danielamartinmtz] Updated StateFulSet k8s obejct in cassandra-svc-statefulset.yaml file in
[danielamartinmtz] Updated documentation including cluster specs.
[noreply] Beam 13058 k8s apis upgrade - elasticsearch (#18)
[danielamartinmtz] Removed code used for testing.
[danielamartinmtz] Removed code used for testing in job_PostCommit_BeamMetrics_Publish
[noreply] Beam 13058 k8s apis upgrade - Adding Basic Auth details in documentation
[Pablo Estrada] [BEAM-14151] Excluding Spanner CDC tests from Dataflow V1 suite
[danielamartinmtz] Added comments in initContainers and remove unused code in elasticsearch
[noreply] [BEAM-14134] Optimize memory allocations for various core coders
[noreply] [BEAM-14129] Restructure PubsubLiteIO Read side to produce smaller
[noreply] [BEAM-12697] Add primitive field generation from IR to SBE extension
[noreply] [BEAM-13889] Add test cases to jsonx package (#17124)
[noreply] Remove unreachable code in container.go (#17166)
[noreply] Add ability to handle streaming input to AvroSchemaIOProvider (#17126)
[noreply] [BEAM-12898] Flink Load Tests failure- UncheckedExecutionException -
[Daniel Oliveira] Moving to 2.39.0-SNAPSHOT on master branch.
------------------------------------------
[...truncated 23.33 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648118861142426826/****\022@29dadb100e39e4a1127319ad7aa94be82fb2e5181b089029abdc9f869ab51ae7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/24 10:47:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648118861142426826/model
2022/03/24 10:47:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0324100345"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648118861142426826/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648118861142426826/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0324100345",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/24 10:47:42 Submitted job: 2022-03-24_03_47_41-10300328665427672270
2022/03/24 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-24_03_47_41-10300328665427672270?project=apache-beam-testing
2022/03/24 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-24_03_47_41-10300328665427672270
2022/03/24 10:47:42 Job state: JOB_STATE_PENDING ...
2022/03/24 10:48:12 Job still running ...
2022/03/24 10:48:42 Job still running ...
2022/03/24 10:49:12 Job still running ...
2022/03/24 10:49:42 Job still running ...
2022/03/24 10:50:12 Job still running ...
2022/03/24 10:50:42 Job still running ...
2022/03/24 10:51:12 Job still running ...
2022/03/24 10:51:42 Job still running ...
2022/03/24 10:52:12 Job still running ...
2022/03/24 10:52:42 Job still running ...
2022/03/24 10:53:13 Failed to execute job: job 2022-03-24_03_47_41-10300328665427672270 failed
panic: Failed to execute job: job 2022-03-24_03_47_41-10300328665427672270 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc000120000, 0x103ddcc, 0x19, 0xc000415e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5skj2lx44poii
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #457
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/457/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13232] Close clients properly in KinesisSource. Also use lazy init
[noreply] [BEAM-14141] Set Interactive Beam to use the default Dataproc image
[noreply] BEAM-14115 - Update find criteria limited to _id (#17102)
[chamikaramj] Disable BigQueryIOStorageWriteIT for general Java post-commit
[noreply] Revert "[BEAM-14038] Auto-startup for Python expansion service.
[noreply] Minor: Bump timeout for Java PreCommit (#17157)
[noreply] [BEAM-14152] Disable flaky
[noreply] Fixing a small bug in TypedSchemaTransformTest that caused it to flake.
[noreply] [BEAM-14116] Catch MonitoringInfoMetricName null keys or values in the
[noreply] [BEAM-14129] Restructure SubscriptionPartitionLoader to use a manual SDF
[noreply] [BEAM-13015] Avoid repeated weighing of StateKey in
[noreply] Add option to add modules to JDK add-open (#17110)
[noreply] [BEAM-13015] Clarify ownership of the list for state caching across
------------------------------------------
[...truncated 23.37 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648032453989186803/****\022@fdfbf7b2a7aa153285cd141a9ac4612328d935e4a656bf403c3e0990ed2d2c0f"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/23 10:47:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648032453989186803/model
2022/03/23 10:47:34 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0323100344"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648032453989186803/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648032453989186803/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0323100344",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/23 10:47:35 Submitted job: 2022-03-23_03_47_34-17368119846882360900
2022/03/23 10:47:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-23_03_47_34-17368119846882360900?project=apache-beam-testing
2022/03/23 10:47:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-23_03_47_34-17368119846882360900
2022/03/23 10:47:35 Job state: JOB_STATE_PENDING ...
2022/03/23 10:48:05 Job still running ...
2022/03/23 10:48:35 Job still running ...
2022/03/23 10:49:05 Job still running ...
2022/03/23 10:49:35 Job still running ...
2022/03/23 10:50:05 Job still running ...
2022/03/23 10:50:35 Job still running ...
2022/03/23 10:51:05 Job still running ...
2022/03/23 10:51:35 Job still running ...
2022/03/23 10:52:05 Job still running ...
2022/03/23 10:52:36 Job still running ...
2022/03/23 10:53:06 Job still running ...
2022/03/23 10:53:36 Failed to execute job: job 2022-03-23_03_47_34-17368119846882360900 failed
panic: Failed to execute job: job 2022-03-23_03_47_34-17368119846882360900 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc000120000, 0x103ddcc, 0x19, 0xc0003b9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 13s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/slj5aqgi2rkly
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #456
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/456/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-14124] Add display data to BQ storage reads.
[mmack] [adhoc] Move aws IT tests to testing package according to best practices
[noreply] fixes static checks and go lint issues (#17138)
[Kyle Weaver] Don't print in task configuration.
[noreply] [BEAM-14136] Clean up staticcheck and linter warnings in the Go SDK
[noreply] Merge pull request #17063 from [BEAM-12164] Fix flaky tests
[noreply] Revert "[BEAM-14112] Avoid storing a generator in _CustomBigQuerySource
[Kyle Weaver] [BEAM-4106] Remove filesToStage from Flink pipeline option list.
[noreply] [BEAM-14071] Enabling Flink on Dataproc for Interactive Beam (#17044)
[noreply] Minor: Bypass schema registry in schemas_test.py (#17108)
------------------------------------------
[...truncated 23.34 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647946053037546510/****\022@fdfbf7b2a7aa153285cd141a9ac4612328d935e4a656bf403c3e0990ed2d2c0f"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/22 10:47:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647946053037546510/model
2022/03/22 10:47:33 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0322100324"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647946053037546510/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647946053037546510/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0322100324",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/22 10:47:34 Submitted job: 2022-03-22_03_47_33-5348470039760918694
2022/03/22 10:47:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-22_03_47_33-5348470039760918694?project=apache-beam-testing
2022/03/22 10:47:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-22_03_47_33-5348470039760918694
2022/03/22 10:47:34 Job state: JOB_STATE_PENDING ...
2022/03/22 10:48:04 Job still running ...
2022/03/22 10:48:34 Job still running ...
2022/03/22 10:49:04 Job still running ...
2022/03/22 10:49:34 Job still running ...
2022/03/22 10:50:04 Job still running ...
2022/03/22 10:50:34 Job still running ...
2022/03/22 10:51:04 Job still running ...
2022/03/22 10:51:34 Job still running ...
2022/03/22 10:52:04 Job still running ...
2022/03/22 10:52:34 Job still running ...
2022/03/22 10:53:05 Failed to execute job: job 2022-03-22_03_47_33-5348470039760918694 failed
panic: Failed to execute job: job 2022-03-22_03_47_33-5348470039760918694 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc000120000, 0x103ddcc, 0x19, 0xc00044de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 42s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ycqna3er3ef2o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #455
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/455/display/redirect>
Changes:
------------------------------------------
[...truncated 23.17 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647859658206979864/****\022@c2d6ee2422c84ef50e59b45552128d2647cef51d35c242dc893b86026678d190"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/21 10:47:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647859658206979864/model
2022/03/21 10:47:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0321100341"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647859658206979864/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647859658206979864/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0321100341",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/21 10:47:39 Submitted job: 2022-03-21_03_47_38-7308465751655851137
2022/03/21 10:47:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-21_03_47_38-7308465751655851137?project=apache-beam-testing
2022/03/21 10:47:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-21_03_47_38-7308465751655851137
2022/03/21 10:47:39 Job state: JOB_STATE_PENDING ...
2022/03/21 10:48:09 Job still running ...
2022/03/21 10:48:39 Job still running ...
2022/03/21 10:49:09 Job still running ...
2022/03/21 10:49:39 Job still running ...
2022/03/21 10:50:09 Job still running ...
2022/03/21 10:50:39 Job still running ...
2022/03/21 10:51:09 Failed to execute job: job 2022-03-21_03_47_38-7308465751655851137 failed
panic: Failed to execute job: job 2022-03-21_03_47_38-7308465751655851137 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc0000480c0, 0x103ddcc, 0x19, 0xc0003e5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3rci6xmr3nl4q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #454
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/454/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14122] Upgrade pip-licenses dependency (#17132)
------------------------------------------
[...truncated 23.34 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647773262527117857/****\022@c2d6ee2422c84ef50e59b45552128d2647cef51d35c242dc893b86026678d190"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/20 10:47:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647773262527117857/model
2022/03/20 10:47:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0320100323"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647773262527117857/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647773262527117857/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0320100323",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/20 10:47:43 Submitted job: 2022-03-20_03_47_43-7429414695827883249
2022/03/20 10:47:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-20_03_47_43-7429414695827883249?project=apache-beam-testing
2022/03/20 10:47:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-20_03_47_43-7429414695827883249
2022/03/20 10:47:43 Job state: JOB_STATE_PENDING ...
2022/03/20 10:48:14 Job still running ...
2022/03/20 10:48:44 Job still running ...
2022/03/20 10:49:14 Job still running ...
2022/03/20 10:49:44 Job still running ...
2022/03/20 10:50:14 Job still running ...
2022/03/20 10:50:44 Job still running ...
2022/03/20 10:51:14 Job still running ...
2022/03/20 10:51:44 Job still running ...
2022/03/20 10:52:14 Job still running ...
2022/03/20 10:52:44 Job still running ...
2022/03/20 10:53:14 Failed to execute job: job 2022-03-20_03_47_43-7429414695827883249 failed
panic: Failed to execute job: job 2022-03-20_03_47_43-7429414695827883249 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc0000480c0, 0x103ddcc, 0x19, 0xc000387e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wvizz6icmcpsy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #453
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/453/display/redirect?page=changes>
Changes:
[Kiley Sok] Add Java 17 Nexmark metrics to Grafana
[yiru] .
[yiru] .
[yiru] .
[yiru] format fix
[yiru] .
[yiru] make DoFn into a separate class
[yiru] .
[yiru] fix setting
[mmack] [adhoc] Minor cleanup for aws2 tests
[mmack] [BEAM-14125] Update website IO matrix to recommend aws2 IOs
[noreply] [BEAM-14128] Eliminating quadratic behavior of
[noreply] [BEAM-13972] Add RunInference interface (#16917)
[noreply] Merge pull request #17116 from [BEAM-12164] Remove change_stream in
[yiru] fix checkstyle
[yiru] spotlessapply
[noreply] Deprecate tags.go (#17025)
[noreply] [BEAM-12753] and [BEAM-12815] Fix Flink Integration Tests (#17067)
[noreply] Merge pull request #16895 from [BEAM-13882][Playground] More tests for
[noreply] [BEAM-13925] Add weekly automation to update our reviewer config
[noreply] Merge pull request #17076 from Beam 14082 update payground for mobile
[noreply] [BEAM-13925] Assign committers in the scheduled action (#17062)
[noreply] Pin setup-gcloud to v0 instead of master (#17123)
[noreply] [BEAM-3304] documentation for PaneInfo in BPG (#17047)
[noreply] Merge pull request #17016 from [BEAM-14049][Playground] Add new API
[noreply] Merge pull request #17077 from [BEAM-14078] [Website] change link
[noreply] Merge pull request #17085 from [BEAM-14077] [Website] add beam
[noreply] Update Changes.md w/Go pipeline pre-process fix.
[noreply] [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088)
[noreply] Merge pull request #17023 from [BEAM-12164]: Remove child partition
------------------------------------------
[...truncated 23.17 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647686866593462404/****\022@c2d6ee2422c84ef50e59b45552128d2647cef51d35c242dc893b86026678d190"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/19 10:47:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647686866593462404/model
2022/03/19 10:47:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0319100338"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647686866593462404/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647686866593462404/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0319100338",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/19 10:47:47 Submitted job: 2022-03-19_03_47_47-2359140158685169868
2022/03/19 10:47:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-19_03_47_47-2359140158685169868?project=apache-beam-testing
2022/03/19 10:47:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-19_03_47_47-2359140158685169868
2022/03/19 10:47:47 Job state: JOB_STATE_PENDING ...
2022/03/19 10:48:18 Job still running ...
2022/03/19 10:48:48 Job still running ...
2022/03/19 10:49:18 Job still running ...
2022/03/19 10:49:48 Job still running ...
2022/03/19 10:50:18 Job still running ...
2022/03/19 10:50:48 Job still running ...
2022/03/19 10:51:18 Failed to execute job: job 2022-03-19_03_47_47-2359140158685169868 failed
panic: Failed to execute job: job 2022-03-19_03_47_47-2359140158685169868 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc00019a000, 0x103ddcc, 0x19, 0xc00026fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kythj53epqjxu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #452
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/452/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage.
[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner
[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)
[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,
[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.
[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource (#17100)
[noreply] Populate environment capabilities in v1beta3 protos. (#17042)
[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in BQ IO.
[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on Dataflow,
[noreply] [BEAM-14038] Auto-startup for Python expansion service. (#17035)
[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.
[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)
[noreply] Merge pull request #16977 from [BEAM-12164] Added integration test for
------------------------------------------
[...truncated 23.41 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647600473763766896/****\022@01bc06f4171ed3cd5c2acdefe13f6415e6237a93c1fc207228d70266276bac2f"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/18 10:47:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647600473763766896/model
2022/03/18 10:47:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0318100332"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647600473763766896/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647600473763766896/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0318100332",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/18 10:47:55 Submitted job: 2022-03-18_03_47_54-6623263280869910999
2022/03/18 10:47:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-18_03_47_54-6623263280869910999?project=apache-beam-testing
2022/03/18 10:47:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-18_03_47_54-6623263280869910999
2022/03/18 10:47:55 Job state: JOB_STATE_PENDING ...
2022/03/18 10:48:25 Job still running ...
2022/03/18 10:48:55 Job still running ...
2022/03/18 10:49:25 Job still running ...
2022/03/18 10:49:55 Job still running ...
2022/03/18 10:50:25 Job still running ...
2022/03/18 10:50:55 Job still running ...
2022/03/18 10:51:25 Job still running ...
2022/03/18 10:51:55 Job still running ...
2022/03/18 10:52:25 Job still running ...
2022/03/18 10:52:55 Job still running ...
2022/03/18 10:53:25 Failed to execute job: job 2022-03-18_03_47_54-6623263280869910999 failed
panic: Failed to execute job: job 2022-03-18_03_47_54-6623263280869910999 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11506e8, 0xc0000480c0, 0x103ddcc, 0x19, 0xc0003fbe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/obhaq3v2apdhi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #451
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/451/display/redirect?page=changes>
Changes:
[noreply] Mapped JOB_STATE_RESOURCE_CLEANING_UP to State.RUNNING.
[ryanthompson591] fixed typo in typehints
[zyichi] Remove unused prebuild_sdk_container_base_iamge option from validate
[hengfeng] feat: add more custom metrics
[noreply] [BEAM-14103][Playgrounf][Bugfix] Fix google analytics id (#17092)
[noreply] Minor: Make ScopedReadStateSupplier final (#16992)
[noreply] [BEAM-14113] Improve SamzaJobServerDriver extensibility (#17099)
[noreply] [BEAM-14116] Chunk commit requests dynamically (#17004)
[noreply] Merge pull request #17079 from [BEAM-13660] Add types and queries in
[noreply] [BEAM-13888] Add unit testing to ioutilx (#17058)
[noreply] Merge pull request #16822 from [BEAM-13841][Playground] Add Application
[noreply] Minor: Make serializableCoder warning gramatically correct english
[noreply] [BEAM-14091] Fixing Interactive Beam show/collect for remote runners
------------------------------------------
[...truncated 23.21 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647514075430034202/****\022@5ca7caf756af029b051d716533e4f263b4aa69fde8d5ad365048cba787d1d21d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/17 10:47:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647514075430034202/model
2022/03/17 10:47:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0317100331"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647514075430034202/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647514075430034202/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0317100331",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/17 10:47:56 Submitted job: 2022-03-17_03_47_56-58913463835548016
2022/03/17 10:47:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-17_03_47_56-58913463835548016?project=apache-beam-testing
2022/03/17 10:47:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-17_03_47_56-58913463835548016
2022/03/17 10:47:56 Job state: JOB_STATE_PENDING ...
2022/03/17 10:48:26 Job still running ...
2022/03/17 10:48:56 Job still running ...
2022/03/17 10:49:26 Job still running ...
2022/03/17 10:49:56 Job still running ...
2022/03/17 10:50:27 Job still running ...
2022/03/17 10:50:57 Job still running ...
2022/03/17 10:51:27 Failed to execute job: job 2022-03-17_03_47_56-58913463835548016 failed
panic: Failed to execute job: job 2022-03-17_03_47_56-58913463835548016 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1150608, 0xc0000480c0, 0x103dcec, 0x19, 0xc0004c7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ccs26n6gxzonc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #450
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/450/display/redirect?page=changes>
Changes:
[Chamikara Madhusanka Jayalath] Updates x-lang release validation to use staged jars
[dhuntsperger] documented maven-to-gradle conversion for Dataflow; refactored java
[dhuntsperger] adding a list of example pipelines
[dhuntsperger] removing unnecessary `ls` command from maven project generation
[mmack] [BEAM-13175] Add KinesisIO.write for AWS SDK v2.
[dhuntsperger] fixing filename formatting in response to feedback
[dhuntsperger] adding extra step emphasizing runner setupt
[dhuntsperger] reorganized instructions to emphasize setup steps for runners
[mmack] [BEAM-13175] Document changes to IOs in amazon-web-services2 for AWS
[noreply] [BEAM-13767] Move a bunch of python tasks to use gradle configuration…
[noreply] Merge pull request #17052 from [BEAM-13818] [SnowflakeIO] Add support
[noreply] Adding pydoc for StateHandler (#17091)
[noreply] BEAM-3165 Bypass split if numSplit is zero (#17084)
------------------------------------------
[...truncated 23.23 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647427666666677818/****\022@5ca7caf756af029b051d716533e4f263b4aa69fde8d5ad365048cba787d1d21d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/16 10:47:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647427666666677818/model
2022/03/16 10:47:47 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0316100339"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647427666666677818/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647427666666677818/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0316100339",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/16 10:47:47 Submitted job: 2022-03-16_03_47_47-14916165417087780007
2022/03/16 10:47:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-16_03_47_47-14916165417087780007?project=apache-beam-testing
2022/03/16 10:47:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-16_03_47_47-14916165417087780007
2022/03/16 10:47:48 Job state: JOB_STATE_PENDING ...
2022/03/16 10:48:18 Job still running ...
2022/03/16 10:48:48 Job still running ...
2022/03/16 10:49:18 Job still running ...
2022/03/16 10:49:48 Job still running ...
2022/03/16 10:50:18 Job still running ...
2022/03/16 10:50:48 Job still running ...
2022/03/16 10:51:18 Failed to execute job: job 2022-03-16_03_47_47-14916165417087780007 failed
panic: Failed to execute job: job 2022-03-16_03_47_47-14916165417087780007 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1150608, 0xc0000480c0, 0x103dcec, 0x19, 0xc00055de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/63fgj23ekool6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #449
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/449/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test
[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test
[benjamin.gonzalez] [BEAM-12572] Add java examples tests
[benjamin.gonzalez] [BEAM-12572] Change tests collected by runner
[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions, skip tests for specific runners
[benjamin.gonzalez] [BEAM-12572] Skip failing tests
[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warnings
[benjamin.gonzalez] [BEAM-12572] Skip tfidf tests on direct runner
[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions
[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warning
[benjamin.gonzalez] [BEAM-12572] Enable test with Pipeline serialization error fixed, link
[benjamin.gonzalez] [BEAM-12572] Sickbay TfIdf test for DirectRunner
[benjamin.gonzalez] [BEAM-12572] Refactor naming for BigQueryClient
[mmack] [adhoc] Update owners for aws modules
[noreply] [BEAM-14051] Add a warning to gradle.properties that many Beam modules
[noreply] Merge pull request #17000 from [BEAM-13881] [Playground] Increase test
[noreply] Add deterministic dict coding via key sorting. (#17037)
[noreply] Merge pull request #17054 from [BEAM-14075] [SnowflakeIO] Change a
------------------------------------------
[...truncated 23.21 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647341275643073640/****\022@5ca7caf756af029b051d716533e4f263b4aa69fde8d5ad365048cba787d1d21d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/15 10:47:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647341275643073640/model
2022/03/15 10:47:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0315100336"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647341275643073640/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647341275643073640/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0315100336",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/15 10:47:56 Submitted job: 2022-03-15_03_47_56-11478584981766776185
2022/03/15 10:47:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-15_03_47_56-11478584981766776185?project=apache-beam-testing
2022/03/15 10:47:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-15_03_47_56-11478584981766776185
2022/03/15 10:47:56 Job state: JOB_STATE_PENDING ...
2022/03/15 10:48:26 Job still running ...
2022/03/15 10:48:57 Job still running ...
2022/03/15 10:49:27 Job still running ...
2022/03/15 10:49:57 Job still running ...
2022/03/15 10:50:27 Job still running ...
2022/03/15 10:50:57 Job still running ...
2022/03/15 10:51:27 Failed to execute job: job 2022-03-15_03_47_56-11478584981766776185 failed
panic: Failed to execute job: job 2022-03-15_03_47_56-11478584981766776185 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1150608, 0xc000128000, 0x103dcec, 0x19, 0xc000825e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 4s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/idkjy5tnzknig
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #448
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/448/display/redirect>
Changes:
------------------------------------------
[...truncated 23.21 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647254866060921425/****\022@5ca7caf756af029b051d716533e4f263b4aa69fde8d5ad365048cba787d1d21d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/14 10:47:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647254866060921425/model
2022/03/14 10:47:46 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0314100321"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647254866060921425/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647254866060921425/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0314100321",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/14 10:47:47 Submitted job: 2022-03-14_03_47_46-10418524689137885623
2022/03/14 10:47:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-14_03_47_46-10418524689137885623?project=apache-beam-testing
2022/03/14 10:47:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-14_03_47_46-10418524689137885623
2022/03/14 10:47:47 Job state: JOB_STATE_PENDING ...
2022/03/14 10:48:17 Job still running ...
2022/03/14 10:48:47 Job still running ...
2022/03/14 10:49:17 Job still running ...
2022/03/14 10:49:47 Job still running ...
2022/03/14 10:50:17 Job still running ...
2022/03/14 10:50:47 Job still running ...
2022/03/14 10:51:17 Failed to execute job: job 2022-03-14_03_47_46-10418524689137885623 failed
panic: Failed to execute job: job 2022-03-14_03_47_46-10418524689137885623 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1150608, 0xc000120000, 0x103dcec, 0x19, 0xc0005ede00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/snp5f6bldpr3g
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #447
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/447/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14072] [BEAM-13993] [BEAM-10039] Import beam plugins before
------------------------------------------
[...truncated 23.15 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647168449394519975/****\022@5ca7caf756af029b051d716533e4f263b4aa69fde8d5ad365048cba787d1d21d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/13 10:47:30 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647168449394519975/model
2022/03/13 10:47:30 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0313100332"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647168449394519975/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647168449394519975/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0313100332",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/13 10:47:31 Submitted job: 2022-03-13_03_47_30-15245238941010920783
2022/03/13 10:47:31 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-13_03_47_30-15245238941010920783?project=apache-beam-testing
2022/03/13 10:47:31 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-13_03_47_30-15245238941010920783
2022/03/13 10:47:31 Job state: JOB_STATE_PENDING ...
2022/03/13 10:48:01 Job still running ...
2022/03/13 10:48:31 Job still running ...
2022/03/13 10:49:02 Job still running ...
2022/03/13 10:49:32 Job still running ...
2022/03/13 10:50:02 Job still running ...
2022/03/13 10:50:32 Job still running ...
2022/03/13 10:51:02 Failed to execute job: job 2022-03-13_03_47_30-15245238941010920783 failed
panic: Failed to execute job: job 2022-03-13_03_47_30-15245238941010920783 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1150608, 0xc000120000, 0x103dcec, 0x19, 0xc0003c3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 40s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dtoo7hsd5weve
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #446
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/446/display/redirect?page=changes>
Changes:
[Ismaël Mejía] [BEAM-13981] Remove Spark Runner specific code for event logging
[vitaly.terentyev] [BEAM-2766] Support null key/values in HadoopFormatIO
[vitaly.terentyev] [BEAM-2766] Fix checkstyle
------------------------------------------
[...truncated 23.19 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647082061792828116/****\022@5ca7caf756af029b051d716533e4f263b4aa69fde8d5ad365048cba787d1d21d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/12 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647082061792828116/model
2022/03/12 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0312100319"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647082061792828116/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647082061792828116/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0312100319",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/12 10:47:43 Submitted job: 2022-03-12_02_47_42-16720958526233351875
2022/03/12 10:47:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-12_02_47_42-16720958526233351875?project=apache-beam-testing
2022/03/12 10:47:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-12_02_47_42-16720958526233351875
2022/03/12 10:47:43 Job state: JOB_STATE_PENDING ...
2022/03/12 10:48:13 Job still running ...
2022/03/12 10:48:43 Job still running ...
2022/03/12 10:49:13 Job still running ...
2022/03/12 10:49:43 Job still running ...
2022/03/12 10:50:13 Job still running ...
2022/03/12 10:50:43 Job still running ...
2022/03/12 10:51:13 Failed to execute job: job 2022-03-12_02_47_42-16720958526233351875 failed
panic: Failed to execute job: job 2022-03-12_02_47_42-16720958526233351875 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1150608, 0xc000120000, 0x103dcec, 0x19, 0xc000345e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ykmdv5zdq7obu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #445
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/445/display/redirect?page=changes>
Changes:
[ihr] [BEAM-13923] Fix the answers placeholders locations in the Java katas
[jakub.kukul] [BEAM-14039] Propagate ignore_unknown_columns parameter.
[stranniknm] [BEAM-14079] playground - improve accessibility
[noreply] [BEAM-13925] Find and address prs that havent been reviewed in a week
[noreply] Fix import path
[noreply] [BEAM-13925] Fix one more import path
[noreply] Add a StatefulDoFn test that sets event time timer within allowed
[noreply] Merge pull request #17056 from [BEAM-14076] [SnowflakeIO] Add support
------------------------------------------
[...truncated 23.44 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646995657499391367/****\022@5ca7caf756af029b051d716533e4f263b4aa69fde8d5ad365048cba787d1d21d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/11 10:47:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646995657499391367/model
2022/03/11 10:47:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0311100317"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646995657499391367/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646995657499391367/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0311100317",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/11 10:47:38 Submitted job: 2022-03-11_02_47_38-12724949891286272590
2022/03/11 10:47:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-11_02_47_38-12724949891286272590?project=apache-beam-testing
2022/03/11 10:47:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-11_02_47_38-12724949891286272590
2022/03/11 10:47:38 Job state: JOB_STATE_PENDING ...
2022/03/11 10:48:08 Job still running ...
2022/03/11 10:48:38 Job still running ...
2022/03/11 10:49:09 Job still running ...
2022/03/11 10:49:39 Job still running ...
2022/03/11 10:50:09 Job still running ...
2022/03/11 10:50:39 Job still running ...
2022/03/11 10:51:09 Job still running ...
2022/03/11 10:51:39 Job still running ...
2022/03/11 10:52:09 Job still running ...
2022/03/11 10:52:39 Job still running ...
2022/03/11 10:53:09 Job still running ...
2022/03/11 10:53:39 Failed to execute job: job 2022-03-11_02_47_38-12724949891286272590 failed
panic: Failed to execute job: job 2022-03-11_02_47_38-12724949891286272590 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1150608, 0xc000120000, 0x103dcec, 0x19, 0xc0002c7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/rbzu2pu3pijpo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #444
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/444/display/redirect?page=changes>
Changes:
[hengfeng] [BEAM-12164]: display the metadata table's name on UI
[noreply] Revert "[BEAM-13993] [BEAM-10039] Import beam plugins before starting
[noreply] Merge pull request #17036 from [BEAM-12164] Convert all static instances
[noreply] fix variable reference (#16991)
[noreply] Merge pull request #16844 from [BEAM-12164]: allow for nanosecond
[noreply] [BEAM-13904] Increase unit testing in the reflectx package (#17024)
------------------------------------------
[...truncated 23.23 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646909258967459145/****\022@5ca7caf756af029b051d716533e4f263b4aa69fde8d5ad365048cba787d1d21d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/10 10:47:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646909258967459145/model
2022/03/10 10:47:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0308201347"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646909258967459145/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646909258967459145/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0308201347",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/10 10:47:40 Submitted job: 2022-03-10_02_47_39-11052785668006690039
2022/03/10 10:47:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-10_02_47_39-11052785668006690039?project=apache-beam-testing
2022/03/10 10:47:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-10_02_47_39-11052785668006690039
2022/03/10 10:47:40 Job state: JOB_STATE_PENDING ...
2022/03/10 10:48:10 Job still running ...
2022/03/10 10:48:40 Job still running ...
2022/03/10 10:49:10 Job still running ...
2022/03/10 10:49:40 Job still running ...
2022/03/10 10:50:10 Job still running ...
2022/03/10 10:50:40 Job still running ...
2022/03/10 10:51:10 Failed to execute job: job 2022-03-10_02_47_39-11052785668006690039 failed
panic: Failed to execute job: job 2022-03-10_02_47_39-11052785668006690039 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1150608, 0xc0000480c0, 0x103dcec, 0x19, 0xc000401e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/j44hdkhc3xfcq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #443
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/443/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Update dataflow API client.
[Robert Bradshaw] Instructions for updating apitools generated files.
[noreply] Merge pull request #17027: [BEAM-11205] Upgrade GCP Libraries BOM
[noreply] [BEAM-13709] Inconsistent behavior when parsing boolean flags across
[noreply] [BEAM-10976] Bundle finalization: Harness and some exec changes (#16980)
[noreply] Merge pull request #16976 from [BEAM-14010] [Website] Add Playground
[noreply] [BEAM-12447] Upgrade cloud build client and add/cleanup options (#17032)
------------------------------------------
[...truncated 23.23 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646822864035101891/****\022@5ca7caf756af029b051d716533e4f263b4aa69fde8d5ad365048cba787d1d21d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/09 10:47:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646822864035101891/model
2022/03/09 10:47:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0308201347"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646822864035101891/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646822864035101891/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0308201347",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/09 10:47:45 Submitted job: 2022-03-09_02_47_44-855711374976209886
2022/03/09 10:47:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-09_02_47_44-855711374976209886?project=apache-beam-testing
2022/03/09 10:47:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-09_02_47_44-855711374976209886
2022/03/09 10:47:45 Job state: JOB_STATE_PENDING ...
2022/03/09 10:48:15 Job still running ...
2022/03/09 10:48:45 Job still running ...
2022/03/09 10:49:15 Job still running ...
2022/03/09 10:49:45 Job still running ...
2022/03/09 10:50:15 Job still running ...
2022/03/09 10:50:45 Job still running ...
2022/03/09 10:51:15 Job still running ...
2022/03/09 10:51:46 Failed to execute job: job 2022-03-09_02_47_44-855711374976209886 failed
panic: Failed to execute job: job 2022-03-09_02_47_44-855711374976209886 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1150608, 0xc0000480c0, 0x103dcec, 0x19, 0xc000229e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 23s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3zjxr3iq7qkjk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #442
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/442/display/redirect?page=changes>
Changes:
[dannymccormick] [BEAM-11085] Test that windows are correctly observed in DoFns
[jrmccluskey] [BEAM-14050] Update taxi.go example instructions
[noreply] Give pr bot write permissions on pr update
[noreply] Adding a logical type for Schemas using proto serialization. (#16940)
[noreply] BEAM-13765 missing PAssert methods (#16668)
[noreply] [BEAM-13909] improve coverage of Provision package (#17014)
------------------------------------------
[...truncated 23.31 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646736452288635233/****\022@d81936da2f45d8032e56445ba891e9cea0677d30215bb9cd89ece232578db145"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/08 10:47:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646736452288635233/model
2022/03/08 10:47:33 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0308101201"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646736452288635233/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646736452288635233/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0308101201",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/08 10:47:33 Submitted job: 2022-03-08_02_47_33-6294258240972849858
2022/03/08 10:47:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-08_02_47_33-6294258240972849858?project=apache-beam-testing
2022/03/08 10:47:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-08_02_47_33-6294258240972849858
2022/03/08 10:47:33 Job state: JOB_STATE_PENDING ...
2022/03/08 10:48:03 Job still running ...
2022/03/08 10:48:33 Job still running ...
2022/03/08 10:49:03 Job still running ...
2022/03/08 10:49:33 Job still running ...
2022/03/08 10:50:03 Job still running ...
2022/03/08 10:50:33 Job still running ...
2022/03/08 10:51:03 Job still running ...
2022/03/08 10:51:33 Job still running ...
2022/03/08 10:52:03 Job still running ...
2022/03/08 10:52:33 Job still running ...
2022/03/08 10:53:04 Failed to execute job: job 2022-03-08_02_47_33-6294258240972849858 failed
panic: Failed to execute job: job 2022-03-08_02_47_33-6294258240972849858 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc000120000, 0x103b0cc, 0x19, 0xc0008d3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jjtw4gc3ez46o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #441
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/441/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13925] Add ability to get metrics on pr-bot performance (#16985)
------------------------------------------
[...truncated 23.20 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646650064354475144/****\022@d81936da2f45d8032e56445ba891e9cea0677d30215bb9cd89ece232578db145"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/07 10:47:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646650064354475144/model
2022/03/07 10:47:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0307101238"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646650064354475144/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646650064354475144/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0307101238",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/07 10:47:47 Submitted job: 2022-03-07_02_47_45-6834906388568505547
2022/03/07 10:47:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-07_02_47_45-6834906388568505547?project=apache-beam-testing
2022/03/07 10:47:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-07_02_47_45-6834906388568505547
2022/03/07 10:47:48 Job state: JOB_STATE_PENDING ...
2022/03/07 10:48:18 Job still running ...
2022/03/07 10:48:48 Job still running ...
2022/03/07 10:49:18 Job still running ...
2022/03/07 10:49:48 Job still running ...
2022/03/07 10:50:18 Job still running ...
2022/03/07 10:50:48 Job still running ...
2022/03/07 10:51:18 Failed to execute job: job 2022-03-07_02_47_45-6834906388568505547 failed
panic: Failed to execute job: job 2022-03-07_02_47_45-6834906388568505547 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc0000480c0, 0x103b0cc, 0x19, 0xc0004d1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/cei7576pbah5c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #440
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/440/display/redirect>
Changes:
------------------------------------------
[...truncated 23.27 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646579984214459408/****\022@d81936da2f45d8032e56445ba891e9cea0677d30215bb9cd89ece232578db145"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/06 15:19:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646579984214459408/model
2022/03/06 15:19:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0306143719"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646579984214459408/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646579984214459408/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0306143719",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/06 15:19:45 Submitted job: 2022-03-06_07_19_44-10837609626873360116
2022/03/06 15:19:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-06_07_19_44-10837609626873360116?project=apache-beam-testing
2022/03/06 15:19:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-06_07_19_44-10837609626873360116
2022/03/06 15:19:45 Job state: JOB_STATE_PENDING ...
2022/03/06 15:20:15 Job still running ...
2022/03/06 15:20:45 Job still running ...
2022/03/06 15:21:16 Job still running ...
2022/03/06 15:21:46 Job still running ...
2022/03/06 15:22:16 Job still running ...
2022/03/06 15:22:46 Job still running ...
2022/03/06 15:23:16 Failed to execute job: job 2022-03-06_07_19_44-10837609626873360116 failed
panic: Failed to execute job: job 2022-03-06_07_19_44-10837609626873360116 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc0000480c0, 0x103b0cc, 0x19, 0xc000403e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xorvul2wqagxe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #439
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/439/display/redirect?page=changes>
Changes:
[rahuliyer573] py: Import beam plugins before starting SdkHarness
[stephen.patel] BEAM-14011 fix s3 filesystem multipart copy
[Valentyn Tymofieiev] Bump numpy bound to include 1.22 and regenerate container deps.
[github-actions] [BEAM-13925] months in date constructor are 0 indexed
[noreply] Merge pull request #16842 from [BEAM-13932][Playground] Container's user
[noreply] Doc updates and blog post for 2.37.0 (#16887)
[noreply] Remove resolved issue in docs + update class path on sample (#17018)
[noreply] [BEAM-14016] Fixed flaky postcommit test (#17009)
[noreply] Remove resolved issue in notebook
[noreply] [BEAM-13947] Add split() and rsplit(), non-deferred column operations on
[noreply] BEAM-14026 - Fixes bug related to Unnesting nested rows in an array
------------------------------------------
[...truncated 23.17 KB...]
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646477256802395199/****\022@d81936da2f45d8032e56445ba891e9cea0677d30215bb9cd89ece232578db145"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/05 10:47:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646477256802395199/model
2022/03/05 10:47:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0305100324"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646477256802395199/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646477256802395199/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0305100324",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/05 10:47:38 Submitted job: 2022-03-05_02_47_37-780981394793146061
2022/03/05 10:47:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-05_02_47_37-780981394793146061?project=apache-beam-testing
2022/03/05 10:47:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-05_02_47_37-780981394793146061
2022/03/05 10:47:38 Job state: JOB_STATE_PENDING ...
2022/03/05 10:48:08 Job still running ...
2022/03/05 10:48:38 Job still running ...
2022/03/05 10:49:08 Job still running ...
2022/03/05 10:49:38 Job still running ...
2022/03/05 10:50:08 Job still running ...
2022/03/05 10:50:38 Failed to execute job: job 2022-03-05_02_47_37-780981394793146061 failed
panic: Failed to execute job: job 2022-03-05_02_47_37-780981394793146061 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc0000480c0, 0x103b0cc, 0x19, 0xc000857e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/azbyvu7nqrhp4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #438
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/438/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-13999] playground - support vertical orientation for graph
[noreply] [adhoc] Prepare aws2 ClientConfiguration for json serialization and
[noreply] Merge pull request #16879 from [BEAM-12164] Add javadocs to
[noreply] [Cleanup] Update pre-v2 go package references (#17002)
[noreply] [BEAM-13885] Add unit tests to window package (#16971)
[noreply] Merge pull request #16891 from [BEAM-13872] [Playground] Increase test
[noreply] Merge pull request #16912 from [BEAM-13878] [Playground] Increase test
[noreply] Merge pull request #16946 from [BEAM-13873] [Playground] Increase test
[noreply] [BEAM-13951] Update mass_comment.py list of Run commands (#16889)
[noreply] [BEAM-10652] Allow Clustering without Partition in BigQuery (#16578)
[noreply] [BEAM-13857] Add K:V flags for expansion service jars and addresses to
------------------------------------------
[...truncated 23.38 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646390863436696431/****\022@d81936da2f45d8032e56445ba891e9cea0677d30215bb9cd89ece232578db145"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/04 10:47:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646390863436696431/model
2022/03/04 10:47:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0304100335"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646390863436696431/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646390863436696431/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0304100335",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/04 10:47:44 Submitted job: 2022-03-04_02_47_44-6921318211559091766
2022/03/04 10:47:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-04_02_47_44-6921318211559091766?project=apache-beam-testing
2022/03/04 10:47:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-04_02_47_44-6921318211559091766
2022/03/04 10:47:45 Job state: JOB_STATE_PENDING ...
2022/03/04 10:48:15 Job still running ...
2022/03/04 10:48:45 Job still running ...
2022/03/04 10:49:15 Job still running ...
2022/03/04 10:49:45 Job still running ...
2022/03/04 10:50:15 Job still running ...
2022/03/04 10:50:45 Job still running ...
2022/03/04 10:51:15 Job still running ...
2022/03/04 10:51:45 Job still running ...
2022/03/04 10:52:15 Job still running ...
2022/03/04 10:52:45 Job still running ...
2022/03/04 10:53:15 Failed to execute job: job 2022-03-04_02_47_44-6921318211559091766 failed
panic: Failed to execute job: job 2022-03-04_02_47_44-6921318211559091766 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc000120000, 0x103b0cc, 0x19, 0xc000759e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/726fvdfjg6uk6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #437
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/437/display/redirect?page=changes>
Changes:
[Alexey Romanenko] Bump org.mongodb:mongo-java-driver to 3.12.10
[noreply] [BEAM-13973] Link Dataproc Flink master URLs to the InteractiveRunner
[noreply] [BEAM-13925] Turn pr bot on for go prs (#16984)
[Pablo Estrada] Skipping flaky sad-path tests for Spanner changestreams
[noreply] [BEAM-13964] Bump kotlin to 1.6.x (#16882)
[noreply] Merge pull request #16906: [BEAM-13974] Handle idle Storage Api streams
[noreply] Merge pull request #16562 from [BEAM-13051][D] Enable pylint warnings
[noreply] [BEAM-13925] A couple small pr-bot bug fixes (#16996)
[noreply] [BEAM-14029] Add getter, setter for target maven repo (#16995)
[noreply] [BEAM-13903] Improve coverage of metricsx package (#16994)
[noreply] [BEAM-13892] Improve coverage of avroio package (#16990)
------------------------------------------
[...truncated 23.37 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646304461295703931/****\022@c9f400b9aef1ed01595317f005ac212a06fff253fb0e73442b0bc64ba0839ed0"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/03 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646304461295703931/model
2022/03/03 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0303100331"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646304461295703931/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646304461295703931/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0303100331",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/03 10:47:42 Submitted job: 2022-03-03_02_47_42-1496635414942823390
2022/03/03 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-03_02_47_42-1496635414942823390?project=apache-beam-testing
2022/03/03 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-03_02_47_42-1496635414942823390
2022/03/03 10:47:42 Job state: JOB_STATE_PENDING ...
2022/03/03 10:48:12 Job still running ...
2022/03/03 10:48:42 Job still running ...
2022/03/03 10:49:12 Job still running ...
2022/03/03 10:49:42 Job still running ...
2022/03/03 10:50:12 Job still running ...
2022/03/03 10:50:42 Job still running ...
2022/03/03 10:51:12 Job still running ...
2022/03/03 10:51:42 Job still running ...
2022/03/03 10:52:12 Job still running ...
2022/03/03 10:52:43 Job still running ...
2022/03/03 10:53:13 Failed to execute job: job 2022-03-03_02_47_42-1496635414942823390 failed
panic: Failed to execute job: job 2022-03-03_02_47_42-1496635414942823390 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc0000480c0, 0x103b0cc, 0x19, 0xc000425e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vpdpevd2umcju
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #436
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/436/display/redirect?page=changes>
Changes:
[egalpin] Use default context output rather than outputWithTimestamp for
[stranniknm] Palo Alto case study - fix link
[rogelio.hernandez] [BEAM-12777] Removed current docs version redirect
[noreply] Merge pull request #16850: [BEAM-11205] Upgrade Libraries BOM
[noreply] Merge pull request #16484 from [BEAM-13633] [Playground] Implement
[noreply] Add 2022 events blog post (#16975)
[noreply] Clean up Go formatter suggestions (#16973)
[noreply] [BEAM-14012] Add go fmt to Github Actions (#16978)
[noreply] [BEAM-13911] Add basic tests to Go direct runner. (#16979)
[noreply] [BEAM-13960] Add support for more types when converting from between row
------------------------------------------
[...truncated 23.20 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646218061914706435/****\022@3eccca6f8719294746e85400db8a7c17fe457bf3d0f96d6a0c1f625b3abd0405"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/02 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646218061914706435/model
2022/03/02 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0302100327"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646218061914706435/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646218061914706435/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0302100327",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/02 10:47:43 Submitted job: 2022-03-02_02_47_42-9627306828586084923
2022/03/02 10:47:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-02_02_47_42-9627306828586084923?project=apache-beam-testing
2022/03/02 10:47:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-02_02_47_42-9627306828586084923
2022/03/02 10:47:43 Job state: JOB_STATE_PENDING ...
2022/03/02 10:48:13 Job still running ...
2022/03/02 10:48:43 Job still running ...
2022/03/02 10:49:13 Job still running ...
2022/03/02 10:49:43 Job still running ...
2022/03/02 10:50:13 Job still running ...
2022/03/02 10:50:43 Job still running ...
2022/03/02 10:51:13 Failed to execute job: job 2022-03-02_02_47_42-9627306828586084923 failed
panic: Failed to execute job: job 2022-03-02_02_47_42-9627306828586084923 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d3e8, 0xc000120000, 0x103b08c, 0x19, 0xc000423e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/p7jl3uv2tt7ew
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #435
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/435/display/redirect?page=changes>
Changes:
[noreply] Build wheels for Python 3.9
[noreply] Merge pull request #16892 from [BEAM-13755] [Playground] Scroll the
[noreply] Merge pull request #16880 from [BEAM-13963][Playground] Get bucket name
[noreply] Merge pull request #16870 from [BEAM-13874][Playground] Tag multifile
[noreply] Merge pull request #16910 from [BEAM-13724] [Playground] Get the default
[noreply] [BEAM-14008] Fix incorrect guava import (#16966)
[noreply] Fix ignored exception in BatchSpannerRead. (#16960)
[noreply] [BEAM-13917] Improve coverage of databaseio package (#16956)
[noreply] [BEAM-13925] Add entry files to process new prs and pr updates for PR
[noreply] [BEAM-13899] Improve coverage of debug package (#16951)
[noreply] [BEAM-13907] Improve coverage of textio package (#16937)
[noreply] [BEAM-9150] Fix beam_PostRelease_Python_Candidate (python RC validation
------------------------------------------
[...truncated 23.38 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646131659398450410/****\022@3eccca6f8719294746e85400db8a7c17fe457bf3d0f96d6a0c1f625b3abd0405"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/01 10:47:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646131659398450410/model
2022/03/01 10:47:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0301100335"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646131659398450410/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646131659398450410/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0301100335",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/03/01 10:47:41 Submitted job: 2022-03-01_02_47_40-10636506050830200063
2022/03/01 10:47:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-01_02_47_40-10636506050830200063?project=apache-beam-testing
2022/03/01 10:47:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-01_02_47_40-10636506050830200063
2022/03/01 10:47:41 Job state: JOB_STATE_PENDING ...
2022/03/01 10:48:11 Job still running ...
2022/03/01 10:48:41 Job still running ...
2022/03/01 10:49:12 Job still running ...
2022/03/01 10:49:42 Job still running ...
2022/03/01 10:50:12 Job still running ...
2022/03/01 10:50:42 Job still running ...
2022/03/01 10:51:12 Job still running ...
2022/03/01 10:51:42 Job still running ...
2022/03/01 10:52:12 Job still running ...
2022/03/01 10:52:43 Job still running ...
2022/03/01 10:53:13 Failed to execute job: job 2022-03-01_02_47_40-10636506050830200063 failed
panic: Failed to execute job: job 2022-03-01_02_47_40-10636506050830200063 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d3e8, 0xc0000480c0, 0x103b08c, 0x19, 0xc0003f7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/t34salktxgwdq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #434
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/434/display/redirect>
Changes:
------------------------------------------
[...truncated 23.40 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646045262211818246/****\022@3eccca6f8719294746e85400db8a7c17fe457bf3d0f96d6a0c1f625b3abd0405"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/28 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646045262211818246/model
2022/02/28 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0228100334"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646045262211818246/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646045262211818246/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0228100334",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/28 10:47:43 Submitted job: 2022-02-28_02_47_42-13833319709641855394
2022/02/28 10:47:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-28_02_47_42-13833319709641855394?project=apache-beam-testing
2022/02/28 10:47:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-28_02_47_42-13833319709641855394
2022/02/28 10:47:43 Job state: JOB_STATE_PENDING ...
2022/02/28 10:48:13 Job still running ...
2022/02/28 10:48:43 Job still running ...
2022/02/28 10:49:13 Job still running ...
2022/02/28 10:49:43 Job still running ...
2022/02/28 10:50:13 Job still running ...
2022/02/28 10:50:43 Job still running ...
2022/02/28 10:51:13 Job still running ...
2022/02/28 10:51:43 Job still running ...
2022/02/28 10:52:13 Job still running ...
2022/02/28 10:52:43 Job still running ...
2022/02/28 10:53:14 Failed to execute job: job 2022-02-28_02_47_42-13833319709641855394 failed
panic: Failed to execute job: job 2022-02-28_02_47_42-13833319709641855394 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d3e8, 0xc0000480c0, 0x103b08c, 0x19, 0xc0004bfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/lwkqilqybl46c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #433
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/433/display/redirect>
Changes:
------------------------------------------
[...truncated 23.16 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645958849441473332/****\022@3eccca6f8719294746e85400db8a7c17fe457bf3d0f96d6a0c1f625b3abd0405"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/27 10:47:30 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645958849441473332/model
2022/02/27 10:47:30 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0227100332"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645958849441473332/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645958849441473332/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0227100332",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/27 10:47:30 Submitted job: 2022-02-27_02_47_30-14518688605917953893
2022/02/27 10:47:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-27_02_47_30-14518688605917953893?project=apache-beam-testing
2022/02/27 10:47:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-27_02_47_30-14518688605917953893
2022/02/27 10:47:30 Job state: JOB_STATE_PENDING ...
2022/02/27 10:48:00 Job still running ...
2022/02/27 10:48:30 Job still running ...
2022/02/27 10:49:00 Job still running ...
2022/02/27 10:49:30 Job still running ...
2022/02/27 10:50:00 Job still running ...
2022/02/27 10:50:30 Job still running ...
2022/02/27 10:51:00 Failed to execute job: job 2022-02-27_02_47_30-14518688605917953893 failed
panic: Failed to execute job: job 2022-02-27_02_47_30-14518688605917953893 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d3e8, 0xc000120000, 0x103b08c, 0x19, 0xc00060be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ete6ymvqlzmoo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #432
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/432/display/redirect?page=changes>
Changes:
[Ankur Goenka] [BEAM-13952] Sickbaying
[noreply] Memoize some objects for timer processing to reduce overhead. (#16207)
[noreply] [BEAM-13965] Use TypeDeserializer if type information is available to
[noreply] [BEAM-13912] Add more coverage for dataflow.go (#16903)
[noreply] [BEAM-12563] swaplevel general function for dataframe and series
[noreply] [BEAM-14001] Update coder.go unit tests (#16952)
[noreply] [BEAM-13910] Improve coverage of gcsx package (#16942)
[noreply] [BEAM-13015] Use a DirectExecutor for state since we are just completing
------------------------------------------
[...truncated 23.45 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645872461531414314/****\022@3eccca6f8719294746e85400db8a7c17fe457bf3d0f96d6a0c1f625b3abd0405"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/26 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645872461531414314/model
2022/02/26 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0226100314"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645872461531414314/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645872461531414314/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0226100314",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/26 10:47:42 Submitted job: 2022-02-26_02_47_42-409260599893761566
2022/02/26 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-26_02_47_42-409260599893761566?project=apache-beam-testing
2022/02/26 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-26_02_47_42-409260599893761566
2022/02/26 10:47:43 Job state: JOB_STATE_PENDING ...
2022/02/26 10:48:13 Job still running ...
2022/02/26 10:48:43 Job still running ...
2022/02/26 10:49:13 Job still running ...
2022/02/26 10:49:43 Job still running ...
2022/02/26 10:50:13 Job still running ...
2022/02/26 10:50:43 Job still running ...
2022/02/26 10:51:13 Job still running ...
2022/02/26 10:51:43 Job still running ...
2022/02/26 10:52:13 Job still running ...
2022/02/26 10:52:43 Job still running ...
2022/02/26 10:53:13 Job still running ...
2022/02/26 10:53:43 Failed to execute job: job 2022-02-26_02_47_42-409260599893761566 failed
panic: Failed to execute job: job 2022-02-26_02_47_42-409260599893761566 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d3e8, 0xc000120000, 0x103b08c, 0x19, 0xc0003efe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xkwvdcou3rb4i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #431
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/431/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] Revert PR#16253 due errors with plugin flaky-test-handler
[noreply] Fix BoundedQueueExecutor and StreamingDataflowWorker to actually limit
[noreply] [BEAM-1857] Add Neo4jIO (#15916)
[noreply] [BEAM-13767] Migrate serveral portable runner tasks to use configuration
[noreply] [BEAM-13996] Removing 'No cluster_manager is associated with the
[noreply] [BEAM-13906] Improve coverage of errors package (#16934)
[noreply] [BEAM-13886] unit tests for trigger package (#16935)
[noreply] [BEAM-4767] Remove beam- prefix from release script tags (#16899)
[noreply] [BEAM-13866] Add small unit tests to errorx, make boolean assignment
[noreply] [BEAM-13925] Add most of the supporting files for the pr management
[noreply] Merge pull request #16846 from [BEAM-12164]: Add sad path tests for
------------------------------------------
[...truncated 23.17 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645786060388156830/****\022@af850525987ae50a52bb49080e427d45e7653c2cf79b755a5159f41b1955b89e"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/25 10:47:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645786060388156830/model
2022/02/25 10:47:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0225100320"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645786060388156830/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645786060388156830/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0225100320",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/25 10:47:42 Submitted job: 2022-02-25_02_47_41-14955016686587161624
2022/02/25 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-25_02_47_41-14955016686587161624?project=apache-beam-testing
2022/02/25 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-25_02_47_41-14955016686587161624
2022/02/25 10:47:42 Job state: JOB_STATE_PENDING ...
2022/02/25 10:48:12 Job still running ...
2022/02/25 10:48:42 Job still running ...
2022/02/25 10:49:12 Job still running ...
2022/02/25 10:49:42 Job still running ...
2022/02/25 10:50:12 Job still running ...
2022/02/25 10:50:42 Job still running ...
2022/02/25 10:51:12 Failed to execute job: job 2022-02-25_02_47_41-14955016686587161624 failed
panic: Failed to execute job: job 2022-02-25_02_47_41-14955016686587161624 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d408, 0xc0000480c0, 0x103b08c, 0x19, 0xc00040be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 50s
12 actionable tasks: 8 executed, 3 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/jta2fsdaobmpa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #430
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/430/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12645] Fix code-cov flakes due to monorepo. (#16925)
[noreply] [BEAM-13969] Deprecate stringx package (#16884)
[noreply] Add Go badge to ReadMe (#16897)
[noreply] [BEAM-13980] Re-add method gone missing in af2f8ee6 (#16918)
[noreply] [BEAM-13884] Improve mtime package (#16924)
[noreply] Minor: Update Go API doc links (#16932)
[noreply] [BEAM-13218] Re-enable
[noreply] Merge pull request #16857 from [BEAM-13662] [Playground] Support
[noreply] Merge pull request #16826 from [BEAM-13870] [Playground] Increase test
------------------------------------------
[...truncated 23.15 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645699651313771780/****\022@a3440717d33299a558b13731d6a8b9ff902d8d829ecd57b1094fdb922a695d10"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/24 10:47:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645699651313771780/model
2022/02/24 10:47:32 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0224100328"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645699651313771780/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645699651313771780/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0224100328",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/24 10:47:32 Submitted job: 2022-02-24_02_47_32-12284163223311022383
2022/02/24 10:47:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-24_02_47_32-12284163223311022383?project=apache-beam-testing
2022/02/24 10:47:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-24_02_47_32-12284163223311022383
2022/02/24 10:47:32 Job state: JOB_STATE_PENDING ...
2022/02/24 10:48:02 Job still running ...
2022/02/24 10:48:32 Job still running ...
2022/02/24 10:49:02 Job still running ...
2022/02/24 10:49:32 Job still running ...
2022/02/24 10:50:02 Job still running ...
2022/02/24 10:50:32 Job still running ...
2022/02/24 10:51:03 Failed to execute job: job 2022-02-24_02_47_32-12284163223311022383 failed
panic: Failed to execute job: job 2022-02-24_02_47_32-12284163223311022383 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d408, 0xc000198000, 0x103b08c, 0x19, 0xc000393e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/s6eai33c6xodc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #429
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/429/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-13796] projection pushdown in BQ IO
[Kyle Weaver] [BEAM-13796] Move test to ReadTest class and correct javadoc for
[Kyle Weaver] [BEAM-13796] Pushdown is not supported on TypedRead#fromQuery.
[noreply] [BEAM-13738] Reenable ignored SQS test after bumping elasticmq for fixed
[noreply] fix build status link (#16907)
[noreply] Merge pull request #16549 from [BEAM-13681][Playground] Refactoring
[noreply] Merge pull request #16732 from [BEAM-13825] [Playground] updated
[noreply] Merge pull request #16683 from [BEAM-13713][Playground] Java graph
[noreply] case study pages - improvements and fixes (#16896)
[noreply] Palo Alto case study (#16915)
------------------------------------------
[...truncated 23.16 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645613259140725453/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/23 10:47:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645613259140725453/model
2022/02/23 10:47:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0223100338"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645613259140725453/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645613259140725453/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0223100338",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/23 10:47:40 Submitted job: 2022-02-23_02_47_39-9196105893054565218
2022/02/23 10:47:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-23_02_47_39-9196105893054565218?project=apache-beam-testing
2022/02/23 10:47:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-23_02_47_39-9196105893054565218
2022/02/23 10:47:40 Job state: JOB_STATE_PENDING ...
2022/02/23 10:48:10 Job still running ...
2022/02/23 10:48:40 Job still running ...
2022/02/23 10:49:10 Job still running ...
2022/02/23 10:49:40 Job still running ...
2022/02/23 10:50:10 Job still running ...
2022/02/23 10:50:40 Job still running ...
2022/02/23 10:51:10 Failed to execute job: job 2022-02-23_02_47_39-9196105893054565218 failed
panic: Failed to execute job: job 2022-02-23_02_47_39-9196105893054565218 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc000120000, 0x103b08c, 0x19, 0xc000407e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/axu7ltj4xs2wg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #428
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/428/display/redirect>
Changes:
------------------------------------------
[...truncated 23.15 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645526899422283259/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/22 10:48:20 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645526899422283259/model
2022/02/22 10:48:20 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0222101334"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645526899422283259/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645526899422283259/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0222101334",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/22 10:48:20 Submitted job: 2022-02-22_02_48_20-11162684285558384121
2022/02/22 10:48:20 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-22_02_48_20-11162684285558384121?project=apache-beam-testing
2022/02/22 10:48:20 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-22_02_48_20-11162684285558384121
2022/02/22 10:48:20 Job state: JOB_STATE_PENDING ...
2022/02/22 10:48:50 Job still running ...
2022/02/22 10:49:20 Job still running ...
2022/02/22 10:49:50 Job still running ...
2022/02/22 10:50:20 Job still running ...
2022/02/22 10:50:50 Job still running ...
2022/02/22 10:51:20 Job still running ...
2022/02/22 10:51:50 Failed to execute job: job 2022-02-22_02_48_20-11162684285558384121 failed
panic: Failed to execute job: job 2022-02-22_02_48_20-11162684285558384121 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc0000480c0, 0x103b08c, 0x19, 0xc000169e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kp65i3x37l57y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #427
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/427/display/redirect>
Changes:
------------------------------------------
[...truncated 23.41 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645467563372158574/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/21 18:19:24 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645467563372158574/model
2022/02/21 18:19:24 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0219185626"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645467563372158574/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645467563372158574/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0219185626",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/21 18:19:25 Submitted job: 2022-02-21_10_19_24-10960520817757720723
2022/02/21 18:19:25 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-21_10_19_24-10960520817757720723?project=apache-beam-testing
2022/02/21 18:19:25 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-21_10_19_24-10960520817757720723
2022/02/21 18:19:25 Job state: JOB_STATE_PENDING ...
2022/02/21 18:19:55 Job still running ...
2022/02/21 18:20:25 Job still running ...
2022/02/21 18:20:55 Job still running ...
2022/02/21 18:21:25 Job still running ...
2022/02/21 18:21:55 Job still running ...
2022/02/21 18:22:25 Job still running ...
2022/02/21 18:22:55 Failed to execute job: job 2022-02-21_10_19_24-10960520817757720723 failed
panic: Failed to execute job: job 2022-02-21_10_19_24-10960520817757720723 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc000118000, 0x103b08c, 0x19, 0xc00060de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jppj6rovgzxra
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #426
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/426/display/redirect?page=changes>
Changes:
[rogelio.hernandez] [BEAM-13051] Pylint misplaced-bare-raise warning enabled
[rogelio.hernandez] [BEAM-13051] Added descriptions to Kinesis and PortableRunner exceptions
[thiagotnunes] fix: fix bug when retrieving either string or json
[noreply] [BEAM-13812] Integrate DataprocClusterManager into Interactive
[noreply] [BEAM-12572] Fix failing python examples tests in Dataflow runner
[noreply] Remove build status from PR (#16902)
------------------------------------------
[...truncated 23.15 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645267661223335442/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/19 10:47:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645267661223335442/model
2022/02/19 10:47:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0219100701"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645267661223335442/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645267661223335442/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0219100701",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/19 10:47:42 Submitted job: 2022-02-19_02_47_41-12151096440068016427
2022/02/19 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-19_02_47_41-12151096440068016427?project=apache-beam-testing
2022/02/19 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-19_02_47_41-12151096440068016427
2022/02/19 10:47:42 Job state: JOB_STATE_PENDING ...
2022/02/19 10:48:13 Job still running ...
2022/02/19 10:48:43 Job still running ...
2022/02/19 10:49:13 Job still running ...
2022/02/19 10:49:43 Job still running ...
2022/02/19 10:50:13 Job still running ...
2022/02/19 10:50:43 Job still running ...
2022/02/19 10:51:13 Failed to execute job: job 2022-02-19_02_47_41-12151096440068016427 failed
panic: Failed to execute job: job 2022-02-19_02_47_41-12151096440068016427 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc0000480c0, 0x103b08c, 0x19, 0xc000661e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/eyuykhpyzbiro
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #425
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/425/display/redirect?page=changes>
Changes:
[Pablo Estrada] Simplify README for new users
[Kenneth Knowles] Disable AfterSynchronizedProcessingTime test on Dataflow
[mmack] [BEAM-13563] Introducing common AWS ClientBuilderFactory to unify
[laraschmidt] Fix final allowskew error to properly handle a large allowedSkew
[noreply] Case studies page improvements (#16702)
[noreply] [BEAM-13946] Add get_dummies(), a non-deferred column operation on
[noreply] [release-2.36.0] Fix pickler argument for 2.36 blog (#16774)
[noreply] [adhoc] Avoid using SerializablePipelineOptions for testing to minimize
------------------------------------------
[...truncated 23.20 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645181256424328690/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/18 10:47:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645181256424328690/model
2022/02/18 10:47:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0218070529"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645181256424328690/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645181256424328690/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0218070529",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/18 10:47:37 Submitted job: 2022-02-18_02_47_37-9667000069565848566
2022/02/18 10:47:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-18_02_47_37-9667000069565848566?project=apache-beam-testing
2022/02/18 10:47:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-18_02_47_37-9667000069565848566
2022/02/18 10:47:37 Job state: JOB_STATE_PENDING ...
2022/02/18 10:48:07 Job still running ...
2022/02/18 10:48:37 Job still running ...
2022/02/18 10:49:07 Job still running ...
2022/02/18 10:49:37 Job still running ...
2022/02/18 10:50:08 Job still running ...
2022/02/18 10:50:38 Job still running ...
2022/02/18 10:51:08 Failed to execute job: job 2022-02-18_02_47_37-9667000069565848566 failed
panic: Failed to execute job: job 2022-02-18_02_47_37-9667000069565848566 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc000120000, 0x103b08c, 0x19, 0xc000145e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vfco5blx524a4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #424
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/424/display/redirect?page=changes>
Changes:
[Jeff Tapper] Update Java LTS roadmap info on website for Java 17
[Kyle Weaver] [BEAM-13106] Support Flink 1.14.
[Kyle Weaver] [BEAM-13106] Reuse executor instead of shutting it down mid-test.
[Kyle Weaver] [BEAM-13106] Prevent infinite wait in Flink savepoint test.
[Ismaël Mejía] [BEAM-13202] Fix typos on tests names for VarianceFnTest
[Ismaël Mejía] [BEAM-13202] Add Coder to CountIfFn.Accum
[Ismaël Mejía] [BEAM-13202] Reuse Count transform code since CountIf is a specific case
[Kenneth Knowles] Add test category UsesProcessingTimeTimers
[Kenneth Knowles] Label tests that need UsesProcessingTimeTimers
[Kenneth Knowles] Exclude UsesProcessingTimeTimers from SamzaRunner tests
[Kyle Weaver] [BEAM-13106] A couple additional fixes to FlinkSavepointTest.
[mmack] [adhoc] Migrate KinesisIOIT to use ITEnvironment for Localstack based IT
[noreply] [BEAM-13955] Fix pylint breakage from #16836 (#16867)
[relax] Fix TableRow conversion for the case of fields named "f"
[noreply] Bump dataflow.fnapi_container_version (#16874)
------------------------------------------
[...truncated 23.14 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645094850487008115/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/17 10:47:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645094850487008115/model
2022/02/17 10:47:31 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0217101431"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645094850487008115/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645094850487008115/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0217101431",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/17 10:47:31 Submitted job: 2022-02-17_02_47_31-15231600428081670482
2022/02/17 10:47:31 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-17_02_47_31-15231600428081670482?project=apache-beam-testing
2022/02/17 10:47:31 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-17_02_47_31-15231600428081670482
2022/02/17 10:47:31 Job state: JOB_STATE_PENDING ...
2022/02/17 10:48:01 Job still running ...
2022/02/17 10:48:32 Job still running ...
2022/02/17 10:49:02 Job still running ...
2022/02/17 10:49:32 Job still running ...
2022/02/17 10:50:02 Job still running ...
2022/02/17 10:50:32 Job still running ...
2022/02/17 10:51:02 Failed to execute job: job 2022-02-17_02_47_31-15231600428081670482 failed
panic: Failed to execute job: job 2022-02-17_02_47_31-15231600428081670482 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc000120000, 0x103b08c, 0x19, 0xc0003f3e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 40s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pujrkberyc7qu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #423
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/423/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-13785] playground - enable scio sdk
[mattcasters] [BEAM-13854] Document casting trick for Avro value serializer in KafkaIO
[noreply] Merge pull request #16838 from [BEAM-13931] - make sure large rows cause
[noreply] Seznam Case Study (#16825)
[noreply] [Website] Apache Hop Case Study (#16824)
[noreply] [BEAM-13694] Force hadoop-hdfs-client in hadoopVersion tests for hdfs
[noreply] [Website] Ricardo - added case study feedback (#16807)
[noreply] Merge pull request #16735 from [BEAM-13827] - fix medium file size
[noreply] Merge pull request #16753 from [BEAM-13837] [Playground] show graph on
------------------------------------------
[...truncated 23.36 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645008464731303102/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/16 10:47:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645008464731303102/model
2022/02/16 10:47:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0216100847"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645008464731303102/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645008464731303102/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0216100847",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/16 10:47:45 Submitted job: 2022-02-16_02_47_45-3744644719524309977
2022/02/16 10:47:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-16_02_47_45-3744644719524309977?project=apache-beam-testing
2022/02/16 10:47:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-16_02_47_45-3744644719524309977
2022/02/16 10:47:45 Job state: JOB_STATE_PENDING ...
2022/02/16 10:48:16 Job still running ...
2022/02/16 10:48:46 Job still running ...
2022/02/16 10:49:16 Job still running ...
2022/02/16 10:49:46 Job still running ...
2022/02/16 10:50:16 Job still running ...
2022/02/16 10:50:46 Job still running ...
2022/02/16 10:51:16 Job still running ...
2022/02/16 10:51:46 Job still running ...
2022/02/16 10:52:16 Job still running ...
2022/02/16 10:52:46 Job still running ...
2022/02/16 10:53:16 Failed to execute job: job 2022-02-16_02_47_45-3744644719524309977 failed
panic: Failed to execute job: job 2022-02-16_02_47_45-3744644719524309977 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc0000480c0, 0x103b08c, 0x19, 0xc0003e7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7qqfannbxet52
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #422
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/422/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-12712] Spark: Exclude looping timer tests.
[Kyle Weaver] [BEAM-13919] Annotate PerKeyOrderingTest with UsesStatefulParDo.
[noreply] Update 2.36.0 blog post to mention ARM64 support
[noreply] Minor: Disable checker framework in nightly snapshot (#16829)
[artur.khanin] Updated example link
[noreply] [BEAM-13860] Make `DoFn.infer_output_type` return element type (#16788)
[noreply] [BEAM-13894] Unit test utilities in the ptest package (#16830)
[Kenneth Knowles] Add test for processing time continuation trigger
[noreply] [BEAM-13922] [Coverage] Make boot.go more testable and add tests
[noreply] Exclude SpannerChangeStream IT from Dataflow V1 postcommit (#16851)
[noreply] [BEAM-13930] Address StateSpec consistency issue between Runner and Fn
------------------------------------------
[...truncated 23.13 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644922052172432159/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/15 10:47:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644922052172432159/model
2022/02/15 10:47:32 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0215101352"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644922052172432159/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644922052172432159/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0215101352",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/15 10:47:33 Submitted job: 2022-02-15_02_47_32-372370130867040260
2022/02/15 10:47:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-15_02_47_32-372370130867040260?project=apache-beam-testing
2022/02/15 10:47:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-15_02_47_32-372370130867040260
2022/02/15 10:47:33 Job state: JOB_STATE_PENDING ...
2022/02/15 10:48:03 Job still running ...
2022/02/15 10:48:33 Job still running ...
2022/02/15 10:49:03 Job still running ...
2022/02/15 10:49:33 Job still running ...
2022/02/15 10:50:03 Job still running ...
2022/02/15 10:50:33 Job still running ...
2022/02/15 10:51:03 Failed to execute job: job 2022-02-15_02_47_32-372370130867040260 failed
panic: Failed to execute job: job 2022-02-15_02_47_32-372370130867040260 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc0000480c0, 0x103b08c, 0x19, 0xc000385e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uki6frpdjjriy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #421
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/421/display/redirect?page=changes>
Changes:
[akustov] fix name project id from secreton scio deploy action
[alexander.zhuravlev] [BEAM-13775] Fixed bug with run button
[ihr] [BEAM-13836] Fix the answers placeholders locations in the Python katas
[noreply] Merge pull request #16703 from [BEAM-13804][Playground][Bugfix] Add
[noreply] Merge pull request #16611 from [BEAM-13712][Playground] Add graph for
[noreply] Merge pull request #16757 from [BEAM-13655] [Playground] Persist the
------------------------------------------
[...truncated 23.38 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644835664446010160/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/14 10:47:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644835664446010160/model
2022/02/14 10:47:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0214100324"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644835664446010160/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644835664446010160/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0214100324",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/14 10:47:45 Submitted job: 2022-02-14_02_47_45-13167984725170944519
2022/02/14 10:47:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-14_02_47_45-13167984725170944519?project=apache-beam-testing
2022/02/14 10:47:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-14_02_47_45-13167984725170944519
2022/02/14 10:47:45 Job state: JOB_STATE_PENDING ...
2022/02/14 10:48:15 Job still running ...
2022/02/14 10:48:45 Job still running ...
2022/02/14 10:49:15 Job still running ...
2022/02/14 10:49:45 Job still running ...
2022/02/14 10:50:15 Job still running ...
2022/02/14 10:50:45 Job still running ...
2022/02/14 10:51:15 Job still running ...
2022/02/14 10:51:45 Job still running ...
2022/02/14 10:52:15 Job still running ...
2022/02/14 10:52:45 Job still running ...
2022/02/14 10:53:16 Failed to execute job: job 2022-02-14_02_47_45-13167984725170944519 failed
panic: Failed to execute job: job 2022-02-14_02_47_45-13167984725170944519 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc00018a000, 0x103b08c, 0x19, 0xc000491e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xlhrpd4q3m23g
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #420
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/420/display/redirect?page=changes>
Changes:
[randomstep] [BEAM-9195] Bump org.testcontainers to 1.16.3
------------------------------------------
[...truncated 23.23 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644749258978140829/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/13 10:47:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644749258978140829/model
2022/02/13 10:47:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0213100327"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644749258978140829/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644749258978140829/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0213100327",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/13 10:47:40 Submitted job: 2022-02-13_02_47_39-16107615229505243144
2022/02/13 10:47:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-13_02_47_39-16107615229505243144?project=apache-beam-testing
2022/02/13 10:47:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-13_02_47_39-16107615229505243144
2022/02/13 10:47:40 Job state: JOB_STATE_PENDING ...
2022/02/13 10:48:10 Job still running ...
2022/02/13 10:48:40 Job still running ...
2022/02/13 10:49:10 Job still running ...
2022/02/13 10:49:40 Job still running ...
2022/02/13 10:50:10 Job still running ...
2022/02/13 10:50:41 Job still running ...
2022/02/13 10:51:11 Job still running ...
2022/02/13 10:51:41 Failed to execute job: job 2022-02-13_02_47_39-16107615229505243144 failed
panic: Failed to execute job: job 2022-02-13_02_47_39-16107615229505243144 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc000120000, 0x103b08c, 0x19, 0xc000353e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jrfvtkmmbkkx6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #419
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/419/display/redirect?page=changes>
Changes:
[Carl Yeksigian] Cache bucket matcher regex in GcsPath
[benjamin.gonzalez] [BEAM-12672] Retry flaky tests
[benjamin.gonzalez] [BEAM-12672] Fix spotlessApply
[laraschmidt] Fixing the log line to properly handle a large allowed skew.
[n] BEAM-13159 Update embedded-redis dependency
[n] address comments
[noreply] Minor: Add 2.38.0 section to CHANGES.md (#16804)
[noreply] [BEAM-12000] Fix typo in portable Python job definition (#16812)
[noreply] [BEAM-12164]: Fixes SpannerChangeStreamIT (#16806)
[noreply] [BEAM-12572] Fix failures in python examples tests (#16781)
[noreply] [BEAM-13921] filter out debeziumIO test for spark runner (#16815)
[noreply] [BEAM-13855] Skip SpannerChangeStreamOrderedWithinKeyIT and
[noreply] [BEAM-13679] playground - move quick start category to the top (#16808)
[noreply] Update license_script.sh (#16789)
[noreply] [BEAM-13908] [Coverage] Better testing coverage for gcpopts (#16816)
[noreply] Merge pull request #16809 from [BEAM-12164] Added integration test for
[noreply] [BEAM-4032]Support staging binary distributions of dependency packages
[noreply] [BEAM-13834] Increase influxDB persistent storage. (#16817)
[noreply] Minor: Fix link to nexmark benchmarks (#16803)
[noreply] Regenerate python container base_image_requirements.txt (#16832)
------------------------------------------
[...truncated 23.35 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644662853925005799/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/12 10:47:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644662853925005799/model
2022/02/12 10:47:34 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0212100529"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644662853925005799/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644662853925005799/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0212100529",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/12 10:47:35 Submitted job: 2022-02-12_02_47_34-6734133163731512270
2022/02/12 10:47:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-12_02_47_34-6734133163731512270?project=apache-beam-testing
2022/02/12 10:47:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-12_02_47_34-6734133163731512270
2022/02/12 10:47:35 Job state: JOB_STATE_PENDING ...
2022/02/12 10:48:05 Job still running ...
2022/02/12 10:48:35 Job still running ...
2022/02/12 10:49:05 Job still running ...
2022/02/12 10:49:35 Job still running ...
2022/02/12 10:50:05 Job still running ...
2022/02/12 10:50:35 Job still running ...
2022/02/12 10:51:05 Job still running ...
2022/02/12 10:51:35 Job still running ...
2022/02/12 10:52:05 Job still running ...
2022/02/12 10:52:36 Job still running ...
2022/02/12 10:53:06 Job still running ...
2022/02/12 10:53:36 Failed to execute job: job 2022-02-12_02_47_34-6734133163731512270 failed
panic: Failed to execute job: job 2022-02-12_02_47_34-6734133163731512270 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc0000480c0, 0x103b08c, 0x19, 0xc000375e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vrvsaj3gcrbl2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #418
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/418/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
FATAL: java.io.IOException: Pipe closed after 0 cycles
java.io.IOException: Pipe closed after 0 cycles
at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:118)
at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:101)
at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:93)
at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:74)
at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:104)
at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to apache-beam-jenkins-15
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1800)
at hudson.remoting.Request.call(Request.java:199)
at hudson.remoting.Channel.call(Channel.java:1000)
at hudson.FilePath.act(FilePath.java:1249)
at org.jenkinsci.plugins.envinject.service.EnvironmentVariablesNodeLoader.gatherEnvVarsForNode(EnvironmentVariablesNodeLoader.java:61)
at org.jenkinsci.plugins.envinject.EnvInjectListener.loadEnvironmentVariablesNode(EnvInjectListener.java:78)
at org.jenkinsci.plugins.envinject.EnvInjectListener.setUpEnvironment(EnvInjectListener.java:42)
at hudson.model.AbstractBuild$AbstractBuildExecution.createLauncher(AbstractBuild.java:604)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:472)
at hudson.model.Run.execute(Run.java:1906)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.remoting.RequestAbortedException
at hudson.remoting.Request.abort(Request.java:345)
at hudson.remoting.Channel.terminate(Channel.java:1085)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:89)
ERROR: apache-beam-jenkins-15 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #417
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/417/display/redirect?page=changes>
Changes:
[david.prieto.rivera] Missing contribution
[noreply] [BEAM-13803] Add support for native iterable side inputs to the Go SDK
[noreply] [BEAM-11095] Better error handling for illegal emit functions (#16776)
[noreply] Merge pull request #16613 from Supporting JdbcIO driver in classpath for
[noreply] Merge pull request #15848 from [BEAM-13835] An any-type implementation
[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define simple generators.
[Valentyn Tymofieiev] Add a container for Python 3.9.
[Valentyn Tymofieiev] Allow job submission with Python 3.9 on Dataflow runner
[Valentyn Tymofieiev] Add Python 3.9 test suites. Keep Dataflow V1 suites unchanged for now.
[Valentyn Tymofieiev] Add py3.9 Github actions suites.
[Valentyn Tymofieiev] Py39 Doc updates.
[Valentyn Tymofieiev] [BEAM-9980] Simplify run_validates_container.sh to avoid branching.
[Valentyn Tymofieiev] Update Cython to a new version that has py39 wheels.
[Valentyn Tymofieiev] [BEAM-13845] Fix comparison with potentially incomparable default
[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define simple generators.
[Valentyn Tymofieiev] Mark Python 3.9 as supported version.
[noreply] [release-2.36.0][website] Fix github release notes script, header for
[noreply] Use shell to run python for setupVirtualenv (#16796)
[Daniel Oliveira] [BEAM-13830] Properly shut down Debezium expansion service in IT script.
[noreply] Merge pull request #16659 from [BEAM-13774][Playground] Add user to
[Valentyn Tymofieiev] [BEAM-13868] Remove gsutil dep from hdfs IT test.
[noreply] [BEAM-13776][Playground] (#16731)
[noreply] [BEAM-13867] Drop NaNs returned by nlargest in flight_delays example
[noreply] Announce Python 3.9 in CHANGES.md (#16802)
[Brian Hulette] Moving to 2.38.0-SNAPSHOT on master branch.
[noreply] [BEAM-11095] Better error handling for iter/reiter/multimap (#16794)
------------------------------------------
[...truncated 23.21 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644490063430151025/****\022@f0f109dee2838ac1b1873e6869c1077d57767098a209a33f9f02b5515a55c27d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/10 10:47:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644490063430151025/model
2022/02/10 10:47:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0210100334"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.38.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644490063430151025/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.38.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644490063430151025/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.38.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0210100334",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/10 10:47:45 Submitted job: 2022-02-10_02_47_44-12284451550842363364
2022/02/10 10:47:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-10_02_47_44-12284451550842363364?project=apache-beam-testing
2022/02/10 10:47:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-10_02_47_44-12284451550842363364
2022/02/10 10:47:45 Job state: JOB_STATE_PENDING ...
2022/02/10 10:48:15 Job still running ...
2022/02/10 10:48:45 Job still running ...
2022/02/10 10:49:15 Job still running ...
2022/02/10 10:49:45 Job still running ...
2022/02/10 10:50:15 Job still running ...
2022/02/10 10:50:45 Job still running ...
2022/02/10 10:51:15 Failed to execute job: job 2022-02-10_02_47_44-12284451550842363364 failed
panic: Failed to execute job: job 2022-02-10_02_47_44-12284451550842363364 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114d428, 0xc000198000, 0x103b08c, 0x19, 0xc00062be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/sg7zf2bvgjgxy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #416
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/416/display/redirect?page=changes>
Changes:
[noreply] Update README.md
[marco.robles] Update README with latest PreCommit Jobs
[marco.robles] Update Postcommit jobs with latest jobs
[marco.robles] Update Performace job tests in readme
[marco.robles] update load job tests with latest updates
[marco.robles] update other jobs test with latest updates
[marco.robles] mismatch links fix
[marco.robles] update trigger phrase for some postCommit jobs
[marco.robles] correct trigger phrases in readme
[marco.robles] add pending jobs to readme
[noreply] Update README.md
[mmack] [BEAM-13246] Add support for S3 Bucket Key at the object level (AWS Sdk
[Ismaël Mejía] [BEAM-13839] Upgrade zstd-jni to version 1.5.2-1
[Pablo Estrada] Output successful rows from BQ Streaming Inserts
[schapman] BEAM-13439 Type annotation for ptransform_fn
[noreply] [BEAM-13606] Fail bundles with failed BigTable mutations (#16751)
[mmack] [adhoc] Remove remaining usage of Powermock from aws2.
[marco.robles] fix broken links in jobs & remove the invalid ones
[Kyle Weaver] Update Dataflow Python dev container images.
[Kiley Sok] Add java 17 to changes
[noreply] [BEAM-12914] Add missing 3.9 opcodes to type inference. (#16761)
[noreply] [BEAM-13321] Initial BigQueryIO externalization. (#16489)
[noreply] [BEAM-13193] Enable process bundle response elements embedding in Java
[noreply] [BEAM-13830] added a debeziumio_expansion_addr flag to GoSDK (#16780)
[noreply] Apply spotless. (#16783)
[Daniel Oliveira] [BEAM-13732] Switch x-lang BigQueryIO expansion service to GCP one.
[noreply] [BEAM-13858] Fix broken github action on :sdks:go:examples:wordCount
[Kiley Sok] add jira for runner v2
[noreply] [BEAM-13732] Go SDK BigQuery IO wrapper. Initial implementation.
[noreply] [BEAM-13732] Add example for Go BigQuery IO wrapper. (#16786)
[noreply] Update CHANGES.md with Go SDK milestones. (#16787)
[noreply] [BEAM-13193] Allow BeamFnDataOutboundObserver to flush elements.
------------------------------------------
[...truncated 23.19 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644403658631116437/****\022@0400446db6eed66b708aee272d1a54c1fbf8e3159df5f294d005c0d0adb852c7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/09 10:47:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644403658631116437/model
2022/02/09 10:47:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0209100758"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644403658631116437/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644403658631116437/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0209100758",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/09 10:47:40 Submitted job: 2022-02-09_02_47_39-15714698505822407959
2022/02/09 10:47:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-09_02_47_39-15714698505822407959?project=apache-beam-testing
2022/02/09 10:47:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-09_02_47_39-15714698505822407959
2022/02/09 10:47:40 Job state: JOB_STATE_PENDING ...
2022/02/09 10:48:10 Job still running ...
2022/02/09 10:48:40 Job still running ...
2022/02/09 10:49:10 Job still running ...
2022/02/09 10:49:40 Job still running ...
2022/02/09 10:50:10 Job still running ...
2022/02/09 10:50:40 Job still running ...
2022/02/09 10:51:10 Failed to execute job: job 2022-02-09_02_47_39-15714698505822407959 failed
panic: Failed to execute job: job 2022-02-09_02_47_39-15714698505822407959 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114bd48, 0xc000120000, 0x1039ce5, 0x19, 0xc00034be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2tuqqafkdjnxk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #415
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/415/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-12976] Log projection pushdown optimizations.
[benjamin.gonzalez] [BEAM-12572] Change jobs to run as cron jobs
[mmack] [BEAM-13840] Fix usage of legacy rawtypes in AWS modules
[alexander.zhuravlev] [BEAM-13820] Changed color of delete icon in pipeline options dropdown,
[noreply] [BEAM-11971] Revert "Fix timer consistency in direct runner" (#16748)
[noreply] [BEAM-13193] Aggregates fn api outbound data/timers of different
[noreply] [BEAM-13767] Migrate a bundle of grade tasks to use configuration
[noreply] Merge pull request #16653 from [BEAM-12164]: Add integration tests for
[noreply] Merge pull request #16728 from [BEAM-13823] Update docs for SnowflakeIO
[noreply] Merge pull request #16660 from [BEAM-13771][Playground] Send multifile
[noreply] Merge pull request #16646 from [BEAM-13643][Playground] Setup running
[noreply] [BEAM-13015] Add state caching benchmark and move benchmarks to their
[noreply] [BEAM-13419] Check for initialization in dataflow runner (#16765)
[noreply] Merge pull request #16701 from [BEAM-13786] [Playground] [Bugfix] Update
[noreply] Merge pull request #16754 from [BEAM-13838][Playground] Add logs in case
[noreply] [BEAM-13293] consistent naming for expansion service address and flag
[noreply] Merge pull request #16700 from [BEAM-13790][Playground] Change logic of
[noreply] [BEAM-13830] update dependency for debeziumio expansion service (#16743)
[noreply] [BEAM-13761] consistent namings for expansion address in Debezium IO
[noreply] [BEAM-13806] Shutting down SchemaIO expansion services from Go VR
[noreply] [release-2.36.0] Update website/changelog for release 2.36.0 (#16627)
[noreply] [BEAM-13848] Update numpy intersphinx link (#16767)
[noreply] [release-23.6.0] Fix JIRA link for 2.36 blog (#16771)
[noreply] [BEAM-13647] Use role for Go worker binary. (#16729)
------------------------------------------
[...truncated 23.22 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644317261686016285/****\022@0400446db6eed66b708aee272d1a54c1fbf8e3159df5f294d005c0d0adb852c7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/08 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644317261686016285/model
2022/02/08 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0208100551"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644317261686016285/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644317261686016285/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0208100551",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/08 10:47:43 Submitted job: 2022-02-08_02_47_42-5529626269972284738
2022/02/08 10:47:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-08_02_47_42-5529626269972284738?project=apache-beam-testing
2022/02/08 10:47:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-08_02_47_42-5529626269972284738
2022/02/08 10:47:43 Job state: JOB_STATE_PENDING ...
2022/02/08 10:48:13 Job still running ...
2022/02/08 10:48:43 Job still running ...
2022/02/08 10:49:13 Job still running ...
2022/02/08 10:49:43 Job still running ...
2022/02/08 10:50:13 Job still running ...
2022/02/08 10:50:43 Job still running ...
2022/02/08 10:51:13 Failed to execute job: job 2022-02-08_02_47_42-5529626269972284738 failed
panic: Failed to execute job: job 2022-02-08_02_47_42-5529626269972284738 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114bd48, 0xc000120000, 0x1039ce5, 0x19, 0xc0005b5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/of4zqezf2h2x2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #414
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/414/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16726 from [BEAM-12164]: Parses change streams
[mmack] [BEAM-13147] Avoid nullness issue during init of AwsModule (AWS Sdk v2)
------------------------------------------
[...truncated 23.78 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/07 15:37:58 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644248278309324272/model
2022/02/07 15:37:58 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0207144853"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644248278309324272/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644248278309324272/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0207144853",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/07 15:38:00 Submitted job: 2022-02-07_07_37_58-6387654616784913888
2022/02/07 15:38:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-07_07_37_58-6387654616784913888?project=apache-beam-testing
2022/02/07 15:38:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-07_07_37_58-6387654616784913888
2022/02/07 15:38:00 Job state: JOB_STATE_PENDING ...
2022/02/07 15:38:30 Job still running ...
2022/02/07 15:39:00 Job still running ...
2022/02/07 15:39:30 Job still running ...
2022/02/07 15:40:00 Job still running ...
2022/02/07 15:40:30 Job still running ...
2022/02/07 15:41:00 Job still running ...
2022/02/07 15:41:30 Failed to execute job: job 2022-02-07_07_37_58-6387654616784913888 failed
panic: Failed to execute job: job 2022-02-07_07_37_58-6387654616784913888 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114a928, 0xc000120000, 0x1038bc5, 0x19, 0xc0002cfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/3sx5x6lk2d744
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #413
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/413/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13663] Remove unused duplicate option for AWS client configuration
[mmack] [BEAM-13203] Deprecate SnsIO.writeAsync for AWS Sdk v2 due to risk of
[noreply] [BEAM-13828] Fix stale bot (#16734)
[noreply] Merge pull request #16364 from [BEAM-13182] Add diagrams to backend
[noreply] [BEAM-13811] Fix save_main_session arg in tests examples (#16709)
[Kiley Sok] Update beam-master version
[noreply] [BEAM-13015] Calculate exception for closing BeamFnDataInboundObserver2
[noreply] Minor doc tweaks for validating vendoring. (#16747)
[noreply] [BEAM-13686] OOM while logging a large pipeline even when logging level
[noreply] [BEAM-13629] Update URL artifact type for Dataflow Go (#16490)
[noreply] [BEAM-13832] Add automated expansion service start-up to JDBCio (#16739)
[noreply] [BEAM-13831] Add automated expansion service infra into Debezium Read()
[noreply] [BEAM-13821] Add automated expansion service start-up to KafkaIO
[noreply] [BEAM-13799] Created a Dataproc cluster manager for Interactive Beam
[noreply] Merge pull request #16727: [BEAM-11971] remove unsafe Concurrent data
------------------------------------------
[...truncated 23.71 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/05 10:47:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644058070530205706/model
2022/02/05 10:47:51 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0205100658"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644058070530205706/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644058070530205706/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0205100658",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/05 10:47:53 Submitted job: 2022-02-05_02_47_51-14708347736070371878
2022/02/05 10:47:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-05_02_47_51-14708347736070371878?project=apache-beam-testing
2022/02/05 10:47:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-05_02_47_51-14708347736070371878
2022/02/05 10:47:53 Job state: JOB_STATE_PENDING ...
2022/02/05 10:48:23 Job still running ...
2022/02/05 10:48:53 Job still running ...
2022/02/05 10:49:23 Job still running ...
2022/02/05 10:49:53 Job still running ...
2022/02/05 10:50:23 Job still running ...
2022/02/05 10:50:53 Job still running ...
2022/02/05 10:51:23 Failed to execute job: job 2022-02-05_02_47_51-14708347736070371878 failed
panic: Failed to execute job: job 2022-02-05_02_47_51-14708347736070371878 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114a928, 0xc000198000, 0x1038bc5, 0x19, 0xc000467e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 58s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4d7adx7nk3yeg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #412
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/412/display/redirect?page=changes>
Changes:
[Kiley Sok] Allow Java 17 to be used in SDK
[Kiley Sok] add testing support
[Kiley Sok] Add more testing support for java 17
[Kiley Sok] workaround for jamm
[Kiley Sok] Add Jenkins test for Java 17
[Kiley Sok] Fix jvm hex and skip errorprone
[Kiley Sok] Fix display data for anonymous classes
[Kiley Sok] fix jpms tests
[Kiley Sok] skip zetasql
[Kiley Sok] spotless
[Kiley Sok] spotless
[Kiley Sok] Fix trigger
[Kiley Sok] skip checker framework
[Kiley Sok] fix app name
[Kiley Sok] remove duplicate property check
[Heejong Lee] [BEAM-13813] Add support for URL artifact to extractStagingToPath
[avilovpavel6] Remove Python SQL Test example from catalog
[relax] Fix timer consistency in direct runner
[noreply] [BEAM-13757] adds pane observation in DoFn (#16629)
[Jan Lukavský] Change links to Books from Amazon to Publisher
[noreply] [BEAM-13605] Add support for pandas 1.4.0 (#16590)
[noreply] [BEAM-13761] adds Debezium IO wrapper for Go SDK (#16642)
[noreply] [BEAM-13024] Unify PipelineOptions behavior (#16719)
[noreply] Update sdks/go/pkg/beam/artifact/materialize_test.go
[noreply] Merge pull request #16605 from [BEAM-13634][Playground] Create a
[noreply] Merge pull request #16593 from [BEAM-13725][Playground] Add graph to the
[noreply] Merge pull request #16699 from [BEAM-13789][Playground] Change logic of
[alexander.chermenin] Fixed CSS for Case study page
------------------------------------------
[...truncated 23.69 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/04 10:47:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643971668308932603/model
2022/02/04 10:47:48 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0204100324"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643971668308932603/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643971668308932603/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0204100324",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/04 10:47:49 Submitted job: 2022-02-04_02_47_48-18193550777586488980
2022/02/04 10:47:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-04_02_47_48-18193550777586488980?project=apache-beam-testing
2022/02/04 10:47:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-04_02_47_48-18193550777586488980
2022/02/04 10:47:49 Job state: JOB_STATE_PENDING ...
2022/02/04 10:48:19 Job still running ...
2022/02/04 10:48:49 Job still running ...
2022/02/04 10:49:19 Job still running ...
2022/02/04 10:49:49 Job still running ...
2022/02/04 10:50:19 Job still running ...
2022/02/04 10:50:49 Job still running ...
2022/02/04 10:51:19 Failed to execute job: job 2022-02-04_02_47_48-18193550777586488980 failed
panic: Failed to execute job: job 2022-02-04_02_47_48-18193550777586488980 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114a868, 0xc000128000, 0x1038bc5, 0x19, 0xc00032be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 56s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/j2f2tptged2aq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #411
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/411/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13737][Playground]
[Robert Bradshaw] Make num-stages counter into an internal counter.
[Kenneth Knowles] [BEAM-13768] Fix NullPointerException in BigQueryStorageSourceBase
[Robert Bradshaw] Avoid packaging avro in the java harness jar.
[mmack] [BEAM-13563] Restructure Kinesis Source for Aws 2 internally to prepare
[noreply] [BEAM-4665] Allow joining a running dataflow pipeline without throwing
[noreply] [BEAM-13801] Add standard coder tests for state backed iterable.
[noreply] [BEAM-13430] Fix provided configuration by removing extendsFrom for
[noreply] [BEAM-12830] Print clearer go version fail message (#16693)
[Jan Lukavský] Add reference to Books to Learning Resources in website
[noreply] Use ThreadLocal for DESERIALIZATION_CONTEXT (#16680)
[noreply] Minor: Add apt update after adding deadsnakes repository in dev env
[noreply] [BEAM-13807] Regenerate container images to get TF 2.8.0 (#16707)
[noreply] [BEAM-13399, BEAM-13683] Eagerly materialize artifacts for automated
[noreply] Merge pull request #16617 from [BEAM-13743] [Playground] Add context
[noreply] Merge pull request #16618 from [BEAM-13744] [Playground] Add context
[noreply] Merge pull request #16698 from [BEAM-13802][Playground] [Bugfix] Clean
[noreply] [BEAM-13293][BEAM-13806] Pipe a SchemaIO flag through Go integration
[noreply] [BEAM-13605] Modify groupby.apply implementation in preparation for
[noreply] Merge pull request #16436 from [BEAM-1330] - DatastoreIO Writes should
------------------------------------------
[...truncated 23.79 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/03 16:25:04 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643905503910599841/model
2022/02/03 16:25:04 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0203153228"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643905503910599841/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643905503910599841/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0203153228",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/03 16:25:05 Submitted job: 2022-02-03_08_25_04-11654904677657584264
2022/02/03 16:25:05 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-03_08_25_04-11654904677657584264?project=apache-beam-testing
2022/02/03 16:25:05 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-03_08_25_04-11654904677657584264
2022/02/03 16:25:05 Job state: JOB_STATE_PENDING ...
2022/02/03 16:25:35 Job still running ...
2022/02/03 16:26:05 Job still running ...
2022/02/03 16:26:35 Job still running ...
2022/02/03 16:27:05 Job still running ...
2022/02/03 16:27:35 Job still running ...
2022/02/03 16:28:05 Job still running ...
2022/02/03 16:28:35 Failed to execute job: job 2022-02-03_08_25_04-11654904677657584264 failed
panic: Failed to execute job: job 2022-02-03_08_25_04-11654904677657584264 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1149648, 0xc000120000, 0x1037b41, 0x19, 0xc0001d7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pdxbjbvvwdnke
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #410
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/410/display/redirect?page=changes>
Changes:
[career] [BEAM-13734] Support cache directories that use GCS buckets
[noreply] Merge pull request #16655 from [BEAM-12164]: Add retry protection to
[noreply] Merge pull request #16586 from [BEAM-13731] FhirIO: Add support for
[noreply] [BEAM-13011] Adds a link to Multi-language Pipelines Tips wiki page
[noreply] [BEAM-12572] Run python examples on multiple runners (#16154)
[noreply] [BEAM-13574] Large Wordcount (#16455)
[noreply] [BEAM-13293] Refactor JDBC IO Go Wrapper (#16686)
[noreply] Edit license script for Java, add manual licenses for xz (#16692)
------------------------------------------
[...truncated 23.64 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/02 10:47:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643798851684796452/model
2022/02/02 10:47:32 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0202100326"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643798851684796452/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643798851684796452/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0202100326",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/02 10:47:33 Submitted job: 2022-02-02_02_47_32-8877095194199215221
2022/02/02 10:47:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-02_02_47_32-8877095194199215221?project=apache-beam-testing
2022/02/02 10:47:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-02_02_47_32-8877095194199215221
2022/02/02 10:47:33 Job state: JOB_STATE_PENDING ...
2022/02/02 10:48:03 Job still running ...
2022/02/02 10:48:33 Job still running ...
2022/02/02 10:49:03 Job still running ...
2022/02/02 10:49:33 Job still running ...
2022/02/02 10:50:03 Job still running ...
2022/02/02 10:50:33 Job still running ...
2022/02/02 10:51:03 Failed to execute job: job 2022-02-02_02_47_32-8877095194199215221 failed
panic: Failed to execute job: job 2022-02-02_02_47_32-8877095194199215221 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1146768, 0xc0000480d0, 0x1035024, 0x19, 0xc000707e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vm2ubhke5jqjs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #409
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/409/display/redirect?page=changes>
Changes:
[daria.malkova] Support SCIO SDK via sbt projects
[samuelw] [BEAM-11648] Share thread pool across RetryManager instances.
[Pablo Estrada] Exclude per-key order tests on Twister2 runner
[mrudary] Generalize S3FileSystem to support multiple URI schemes.
[Heejong Lee] Fix Java SDK container image name for load-tests and nexmark
[daria.malkova] Change executable name fo go tests
[avilovpavel6] Fix java test
[noreply] [BEAM-13769] Skip test_main_session_not_staged_when_using_cloudpickle
[noreply] [BEAM-6744] Support implicitly setting project id in Go Dataflow runner
[noreply] Merge pull request #16493 from [BEAM-13632][Playground] Save catalog
[noreply] Exclude jul-to-slf4j from Spark runner in quickstart POM templates
[noreply] [BEAM-11936] Enable a few errorprone checks that were broken by pinned
[noreply] [BEAM-13780] Add CONTRIBUTING.md pointing to main guide (#16666)
[noreply] [BEAM-13777] Accept cache capacity as input parameter instead of default
[noreply] [BEAM-13051][A] Enable pylint warnings
[noreply] [BEAM-13779] Fix pr labeling (#16665)
[noreply] Merge pull request #16581 from [BEAM-12164]: Add
[noreply] Fix labeler trigger (#16674)
[noreply] [BEAM-13781] Exclude grpc-netty-shaded from gax-grpc's dependency
[noreply] [BEAM-13051] Fixed pylint warnings : raising-non-exception (E0710),
[noreply] [BEAM-13740] Correctly install go before running tests (#16673)
[noreply] [BEAM-12830] Update local Docker env Go version. (#16670)
[noreply] [BEAM-13051][B] Enable pylint warnings
[noreply] [BEAM-13430] Revert Spark libraries in Spark runner to provided (#16675)
[noreply] [BEAM-12240] Add Java 17 support (#16568)
[noreply] [BEAM-13760] Add random component to default python dataflow job name
------------------------------------------
[...truncated 23.74 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/01 10:47:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643712463791920081/model
2022/02/01 10:47:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0201100315"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643712463791920081/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643712463791920081/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0201100315",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/02/01 10:47:45 Submitted job: 2022-02-01_02_47_44-13385215627538804943
2022/02/01 10:47:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-01_02_47_44-13385215627538804943?project=apache-beam-testing
2022/02/01 10:47:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-01_02_47_44-13385215627538804943
2022/02/01 10:47:45 Job state: JOB_STATE_PENDING ...
2022/02/01 10:48:15 Job still running ...
2022/02/01 10:48:45 Job still running ...
2022/02/01 10:49:15 Job still running ...
2022/02/01 10:49:45 Job still running ...
2022/02/01 10:50:15 Job still running ...
2022/02/01 10:50:45 Job still running ...
2022/02/01 10:51:15 Failed to execute job: job 2022-02-01_02_47_44-13385215627538804943 failed
panic: Failed to execute job: job 2022-02-01_02_47_44-13385215627538804943 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1146768, 0xc0000480d0, 0x1035024, 0x19, 0xc000225e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zpdb46uvmc7nw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #408
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/408/display/redirect>
Changes:
------------------------------------------
[...truncated 23.69 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/31 10:47:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643626057968367963/model
2022/01/31 10:47:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0131100323"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643626057968367963/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643626057968367963/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0131100323",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/31 10:47:39 Submitted job: 2022-01-31_02_47_38-5066909710147072162
2022/01/31 10:47:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-31_02_47_38-5066909710147072162?project=apache-beam-testing
2022/01/31 10:47:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-31_02_47_38-5066909710147072162
2022/01/31 10:47:39 Job state: JOB_STATE_PENDING ...
2022/01/31 10:48:09 Job still running ...
2022/01/31 10:48:39 Job still running ...
2022/01/31 10:49:09 Job still running ...
2022/01/31 10:49:39 Job still running ...
2022/01/31 10:50:09 Job still running ...
2022/01/31 10:50:39 Job still running ...
2022/01/31 10:51:09 Failed to execute job: job 2022-01-31_02_47_38-5066909710147072162 failed
panic: Failed to execute job: job 2022-01-31_02_47_38-5066909710147072162 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1146768, 0xc000128000, 0x1035024, 0x19, 0xc0004dbe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fral4ydtaa6ee
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #407
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/407/display/redirect>
Changes:
------------------------------------------
[...truncated 23.71 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/30 10:47:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643539658417718290/model
2022/01/30 10:47:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0130100303"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643539658417718290/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643539658417718290/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0130100303",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/30 10:47:42 Submitted job: 2022-01-30_02_47_39-9472058821579825699
2022/01/30 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-30_02_47_39-9472058821579825699?project=apache-beam-testing
2022/01/30 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-30_02_47_39-9472058821579825699
2022/01/30 10:47:42 Job state: JOB_STATE_PENDING ...
2022/01/30 10:48:12 Job still running ...
2022/01/30 10:48:42 Job still running ...
2022/01/30 10:49:12 Job still running ...
2022/01/30 10:49:42 Job still running ...
2022/01/30 10:50:12 Job still running ...
2022/01/30 10:50:42 Job still running ...
2022/01/30 10:51:13 Failed to execute job: job 2022-01-30_02_47_39-9472058821579825699 failed
panic: Failed to execute job: job 2022-01-30_02_47_39-9472058821579825699 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1146768, 0xc000120000, 0x1035024, 0x19, 0xc000515e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ya4rsc5syhb22
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #406
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/406/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-13751] Don't block on gcloud when attempting to get default GCP
[Kyle Weaver] [BEAM-13751] Parameterize wait timeout so test doesn't waste 2s.
[Kyle Weaver] [BEAM-13751] Add comment explaining sleep.
[noreply] Update Python SDK beam-master tags (#16630)
[noreply] Merge pull request #16592 from [BEAM-13722][Playground] Add precompiling
[noreply] Merge pull request #16505 from [BEAM-13527] [Playground] Pipeline
[noreply] [BEAM-13293] XLang Jdbc IO for Go SDK (#16111)
[noreply] [BEAM-10206] Add Go Vet to Github Actions (#16612)
------------------------------------------
[...truncated 23.76 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/29 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643453261987592006/model
2022/01/29 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0129100336"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643453261987592006/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643453261987592006/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0129100336",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/29 10:47:45 Submitted job: 2022-01-29_02_47_42-12350722045737018416
2022/01/29 10:47:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-29_02_47_42-12350722045737018416?project=apache-beam-testing
2022/01/29 10:47:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-29_02_47_42-12350722045737018416
2022/01/29 10:47:45 Job state: JOB_STATE_PENDING ...
2022/01/29 10:48:15 Job still running ...
2022/01/29 10:48:45 Job still running ...
2022/01/29 10:49:15 Job still running ...
2022/01/29 10:49:45 Job still running ...
2022/01/29 10:50:15 Job still running ...
2022/01/29 10:50:45 Job still running ...
2022/01/29 10:51:15 Job still running ...
2022/01/29 10:51:45 Failed to execute job: job 2022-01-29_02_47_42-12350722045737018416 failed
panic: Failed to execute job: job 2022-01-29_02_47_42-12350722045737018416 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1146768, 0xc0000480d0, 0x1035024, 0x19, 0xc000347e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 24s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vzyzz3zmq6zu6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #405
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/405/display/redirect?page=changes>
Changes:
[marcin.kuthan] Get rid of unnessecary logs for BigQuery streaming writes in
[dhuntsperger] added GitHub example references to Python multilang quickstart
[mmack] [adhoc] Test S3Options and AwsOptions for Sdk v2
[noreply] [BEAM-13537] Fix NPE in kafkatopubsub example (#16625)
[noreply] [BEAM-13740] update java_tests.yml to remove setup-go, which is
[Heejong Lee] Fix google3 import error
[noreply] [BEAM-12976] Implement Java projection pushdown optimizer. (#16513)
[noreply] Merge pull request #16579 from Revert "Revert "Merge pull request #15863
[noreply] Merge pull request #16606 from [BEAM-13247] [Playground] Embedding
------------------------------------------
[...truncated 23.76 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/28 10:48:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643366879864781608/model
2022/01/28 10:48:00 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0128100329"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643366879864781608/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643366879864781608/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0128100329",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/28 10:48:01 Submitted job: 2022-01-28_02_48_00-9699013145670191153
2022/01/28 10:48:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-28_02_48_00-9699013145670191153?project=apache-beam-testing
2022/01/28 10:48:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-28_02_48_00-9699013145670191153
2022/01/28 10:48:01 Job state: JOB_STATE_PENDING ...
2022/01/28 10:48:31 Job still running ...
2022/01/28 10:49:01 Job still running ...
2022/01/28 10:49:31 Job still running ...
2022/01/28 10:50:01 Job still running ...
2022/01/28 10:50:31 Job still running ...
2022/01/28 10:51:01 Job still running ...
2022/01/28 10:51:31 Job still running ...
2022/01/28 10:52:02 Failed to execute job: job 2022-01-28_02_48_00-9699013145670191153 failed
panic: Failed to execute job: job 2022-01-28_02_48_00-9699013145670191153 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1145168, 0xc00018a000, 0x1033d4b, 0x19, 0xc000671e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 35s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iey5hyt4yihdg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #404
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/404/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-13093] Enable JavaUsingPython CrossLanguageValidateRunner test for
[mmack] [BEAM-8807] Add integration test for SnsIO.write (Sdk v1 & v2)
[mmack] [BEAM-13746] Fix deserialization of SSECustomerKey for AWS Sdk v2
[noreply] [BEAM-7928] Allow users to specify worker disk type for Dataflow runner
[noreply] Merge pull request #16534 from [BEAM-13671][Playground] Add backend
[noreply] [BEAM-13271] Bump errorprone to 2.10.0 (#16231)
[noreply] [BEAM-13595] Don't load main session when cloudpickle is used. (#16589)
[Heejong Lee] Update readme for XVR tests
------------------------------------------
[...truncated 24.11 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/27 10:47:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643280468552642492/model
2022/01/27 10:47:49 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0127100320"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643280468552642492/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643280468552642492/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0127100320",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/27 10:47:50 Submitted job: 2022-01-27_02_47_49-10375006872733973227
2022/01/27 10:47:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-27_02_47_49-10375006872733973227?project=apache-beam-testing
2022/01/27 10:47:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-27_02_47_49-10375006872733973227
2022/01/27 10:47:50 Job state: JOB_STATE_PENDING ...
2022/01/27 10:48:20 Job still running ...
2022/01/27 10:48:50 Job still running ...
2022/01/27 10:49:20 Job still running ...
2022/01/27 10:49:50 Job still running ...
2022/01/27 10:50:20 Job still running ...
2022/01/27 10:50:50 Job still running ...
2022/01/27 10:51:20 Failed to execute job: job 2022-01-27_02_47_49-10375006872733973227 failed
panic: Failed to execute job: job 2022-01-27_02_47_49-10375006872733973227 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1145168, 0xc00018a000, 0x1033d4b, 0x19, 0xc000441e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 57s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/jgh7d57vinqik
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #403
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/403/display/redirect?page=changes>
Changes:
[artur.khanin] Privacy policy update regarding Apache Beam Playground
[Daniel Oliveira] [BEAM-13321] Fix exception with BigQuery StreamWriter TraceID.
[mmack] [BEAM-13510] Don't retry on invalid SQS receipt handles.
[noreply] [BEAM-13736] Make lifting cache exact. (#16603)
[noreply] Merge pull request #16565 from [BEAM-13692][Playground] Implement
[noreply] Merge pull request #16502 from [BEAM-13650][Playground] Add link for
[noreply] [BEAM-13310] remove call to get offset consumer config, which was rep…
------------------------------------------
[...truncated 23.93 KB...]
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/26 10:47:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643194074094178466/model
2022/01/26 10:47:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0126100333"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643194074094178466/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643194074094178466/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0126100333",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/26 10:47:55 Submitted job: 2022-01-26_02_47_54-8108038928429803062
2022/01/26 10:47:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-26_02_47_54-8108038928429803062?project=apache-beam-testing
2022/01/26 10:47:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-26_02_47_54-8108038928429803062
2022/01/26 10:47:55 Job state: JOB_STATE_PENDING ...
2022/01/26 10:48:25 Job still running ...
2022/01/26 10:48:55 Job still running ...
2022/01/26 10:49:25 Job still running ...
2022/01/26 10:49:55 Job still running ...
2022/01/26 10:50:25 Job still running ...
2022/01/26 10:50:55 Job still running ...
2022/01/26 10:51:25 Job still running ...
2022/01/26 10:51:55 Job still running ...
2022/01/26 10:52:25 Job still running ...
2022/01/26 10:52:55 Job still running ...
2022/01/26 10:53:26 Failed to execute job: job 2022-01-26_02_47_54-8108038928429803062 failed
panic: Failed to execute job: job 2022-01-26_02_47_54-8108038928429803062 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1145108, 0xc000120000, 0x1033d22, 0x19, 0xc00041de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 3s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/xuqikpfot5noe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #402
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/402/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-13716] Clear before creating a new virtual environment in
[mmack] [BEAM-13653] Make SnsIO.write topicArn optional. If provided, validate
[noreply] [BEAM-10897] Update the fastavro lower bound due to an issue on Windows
[noreply] [BEAM-13605] Update pandas_doctests_test denylists in preparation for
[noreply] Merge pull request #16538 from [BEAM-13676][Playground][Bugfix]Build Of
[noreply] Merge pull request #16582 from [BEAM-13711] [Playground] [Bugfix] Add
[noreply] Merge pull request #16515 from [BEAM-13636] [Playground] Checking the
[ningkang0957] [BEAM-13275] Removed the explicit selenium dependency from setup
[noreply] [BEAM-10206] Deprecate unused shallow cloning functions (#16600)
[noreply] Bump Dataflow container versions (#16602)
[noreply] Improved multi-language pipelines section of the programming guide
------------------------------------------
[...truncated 23.71 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/25 10:47:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643107670191292670/model
2022/01/25 10:47:50 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0125100320"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643107670191292670/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643107670191292670/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0125100320",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/25 10:47:51 Submitted job: 2022-01-25_02_47_50-2082408075199363173
2022/01/25 10:47:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-25_02_47_50-2082408075199363173?project=apache-beam-testing
2022/01/25 10:47:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-25_02_47_50-2082408075199363173
2022/01/25 10:47:51 Job state: JOB_STATE_PENDING ...
2022/01/25 10:48:21 Job still running ...
2022/01/25 10:48:51 Job still running ...
2022/01/25 10:49:21 Job still running ...
2022/01/25 10:49:51 Job still running ...
2022/01/25 10:50:21 Job still running ...
2022/01/25 10:50:51 Job still running ...
2022/01/25 10:51:21 Failed to execute job: job 2022-01-25_02_47_50-2082408075199363173 failed
panic: Failed to execute job: job 2022-01-25_02_47_50-2082408075199363173 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143b08, 0xc000120000, 0x1032842, 0x19, 0xc0004dfe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 58s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/o3knvsnajchag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #401
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/401/display/redirect>
Changes:
------------------------------------------
[...truncated 23.93 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/24 10:47:35 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643021254916340464/model
2022/01/24 10:47:35 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0124100307"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643021254916340464/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643021254916340464/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0124100307",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/24 10:47:38 Submitted job: 2022-01-24_02_47_35-4231684730718619940
2022/01/24 10:47:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-24_02_47_35-4231684730718619940?project=apache-beam-testing
2022/01/24 10:47:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-24_02_47_35-4231684730718619940
2022/01/24 10:47:38 Job state: JOB_STATE_PENDING ...
2022/01/24 10:48:08 Job still running ...
2022/01/24 10:48:38 Job still running ...
2022/01/24 10:49:08 Job still running ...
2022/01/24 10:49:38 Job still running ...
2022/01/24 10:50:08 Job still running ...
2022/01/24 10:50:39 Job still running ...
2022/01/24 10:51:09 Job still running ...
2022/01/24 10:51:39 Job still running ...
2022/01/24 10:52:09 Job still running ...
2022/01/24 10:52:39 Job still running ...
2022/01/24 10:53:09 Job still running ...
2022/01/24 10:53:39 Failed to execute job: job 2022-01-24_02_47_35-4231684730718619940 failed
panic: Failed to execute job: job 2022-01-24_02_47_35-4231684730718619940 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143b08, 0xc000128000, 0x1032842, 0x19, 0xc0003e5e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/73b443j2267ly
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #400
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/400/display/redirect>
Changes:
------------------------------------------
[...truncated 23.93 KB...]
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/23 10:47:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642934858146513155/model
2022/01/23 10:47:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0123100309"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642934858146513155/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642934858146513155/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0123100309",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/23 10:47:39 Submitted job: 2022-01-23_02_47_38-8351370616050151953
2022/01/23 10:47:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-23_02_47_38-8351370616050151953?project=apache-beam-testing
2022/01/23 10:47:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-23_02_47_38-8351370616050151953
2022/01/23 10:47:39 Job state: JOB_STATE_PENDING ...
2022/01/23 10:48:09 Job still running ...
2022/01/23 10:48:39 Job still running ...
2022/01/23 10:49:09 Job still running ...
2022/01/23 10:49:39 Job still running ...
2022/01/23 10:50:09 Job still running ...
2022/01/23 10:50:39 Job still running ...
2022/01/23 10:51:10 Job still running ...
2022/01/23 10:51:40 Job still running ...
2022/01/23 10:52:10 Job still running ...
2022/01/23 10:52:40 Job still running ...
2022/01/23 10:53:10 Job still running ...
2022/01/23 10:53:40 Failed to execute job: job 2022-01-23_02_47_38-8351370616050151953 failed
panic: Failed to execute job: job 2022-01-23_02_47_38-8351370616050151953 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143b08, 0xc0000480b0, 0x1032842, 0x19, 0xc000367e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/cnror4keu6sus
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #399
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/399/display/redirect?page=changes>
Changes:
[ningkang0957] [BEAM-13687] Improved Spanner IO request count metrics
[noreply] [BEAM-10206] Add key for fields in wrapper (#16583)
[noreply] Merge pull request #16530 from Adding JSON support in SpannerIO and
[noreply] [BEAM-13685] Enable users to specify cache directory under Interactive
------------------------------------------
[...truncated 23.74 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/22 10:47:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642848458393391653/model
2022/01/22 10:47:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0122100324"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642848458393391653/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642848458393391653/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0122100324",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/22 10:47:40 Submitted job: 2022-01-22_02_47_39-5880762971817299856
2022/01/22 10:47:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-22_02_47_39-5880762971817299856?project=apache-beam-testing
2022/01/22 10:47:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-22_02_47_39-5880762971817299856
2022/01/22 10:47:40 Job state: JOB_STATE_PENDING ...
2022/01/22 10:48:10 Job still running ...
2022/01/22 10:48:40 Job still running ...
2022/01/22 10:49:10 Job still running ...
2022/01/22 10:49:40 Job still running ...
2022/01/22 10:50:10 Job still running ...
2022/01/22 10:50:40 Job still running ...
2022/01/22 10:51:10 Job still running ...
2022/01/22 10:51:41 Failed to execute job: job 2022-01-22_02_47_39-5880762971817299856 failed
panic: Failed to execute job: job 2022-01-22_02_47_39-5880762971817299856 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143b08, 0xc0000480b0, 0x1032842, 0x19, 0xc000351e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/esqtdr5eiamgi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #398
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/398/display/redirect?page=changes>
Changes:
[thiagotnunes] [BEAM-12164]: Add SDF for reading change stream records
[tuyarer] [BEAM-13577] Beam Select's uniquifyNames function loses nullability of
[sergey.kalinin] Update GH Actions to use proper variables names and proper triggers
[dhuntsperger] edited README and comments in Python multi-lang pipes examples
[Pablo Estrada] Revert "Merge pull request #15863 from [BEAM-13184] Autosharding for
[Pablo Estrada] BEAM-13611 reactivating jdbcio xlang test
[Steve Niemitz] [BEAM-13689] Output token elements when BQ batch writes complete.
[noreply] Merge pull request #16371 from [BEAM-13518][Playground] Beam Playground
[noreply] Update Java FnAPI beam master (#16572)
[noreply] [BEAM-13699] Replace fnv with maphash. (#16573)
[noreply] [BEAM-13693] Bump
[noreply] [BEAM-10206] Remove Fatalf calls in non-test goroutines for
[noreply] [BEAM-13430] Re-add provided configuration (#16552)
[noreply] Merge pull request #16540 from [BEAM-13678][Playground]Update Github
[noreply] Merge pull request #16546 from [BEAM-13661] [BEAM-13704] [Playground]
[noreply] Merge pull request #16369 from [BEAM-13558] [Playground] Hide the Graph
------------------------------------------
[...truncated 23.74 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/21 10:47:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642762062943683631/model
2022/01/21 10:47:43 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0121100311"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642762062943683631/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642762062943683631/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0121100311",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/21 10:47:44 Submitted job: 2022-01-21_02_47_43-2173988704081146405
2022/01/21 10:47:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-21_02_47_43-2173988704081146405?project=apache-beam-testing
2022/01/21 10:47:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-21_02_47_43-2173988704081146405
2022/01/21 10:47:44 Job state: JOB_STATE_PENDING ...
2022/01/21 10:48:14 Job still running ...
2022/01/21 10:48:44 Job still running ...
2022/01/21 10:49:14 Job still running ...
2022/01/21 10:49:44 Job still running ...
2022/01/21 10:50:14 Job still running ...
2022/01/21 10:50:44 Job still running ...
2022/01/21 10:51:14 Failed to execute job: job 2022-01-21_02_47_43-2173988704081146405 failed
panic: Failed to execute job: job 2022-01-21_02_47_43-2173988704081146405 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143b08, 0xc000120000, 0x1032842, 0x19, 0xc000405e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wdcjiv7uqpka4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #397
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/397/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13015] Provide caching statistics in the status client. (#16495)
[noreply] [BEAM-13611] Skip test_xlang_jdbc_write (#16554)
[noreply] Merge pull request #16370 from [BEAM-13556] playground - color and
[noreply] Merge pull request #16531 from [BEAM-13567] [playground] Handle run code
[noreply] Merge pull request #16533 from [BEAM-13548] [Playground] Add example
[noreply] Merge pull request #16519 from [BEAM-13639] [Playground] Add
[noreply] Merge pull request #16518 from [BEAM-13619] [Playground] Add loading
[noreply] Merge pull request #16243 from
[noreply] [BEAM-13683] Make cross-language SQL example pipeline (#16567)
[noreply] [BEAM-13688] fixed type in BPG 4.5.3 window section (#16560)
[noreply] Remove obsolete commands from Inventory job. (#16564)
[noreply] Disable logging for memoization test. (#16556)
[noreply] Merge pull request #16472: [BEAM-13697] Add SchemaFieldNumber annotation
[noreply] Merge pull request #16373 from [BEAM-13515] [Playground] Hiding lines in
------------------------------------------
[...truncated 23.70 KB...]
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/20 10:47:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642675656370697713/model
2022/01/20 10:47:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0120100311"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642675656370697713/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642675656370697713/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0120100311",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/20 10:47:38 Submitted job: 2022-01-20_02_47_37-8161018057026660740
2022/01/20 10:47:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-20_02_47_37-8161018057026660740?project=apache-beam-testing
2022/01/20 10:47:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-20_02_47_37-8161018057026660740
2022/01/20 10:47:38 Job state: JOB_STATE_PENDING ...
2022/01/20 10:48:08 Job still running ...
2022/01/20 10:48:38 Job still running ...
2022/01/20 10:49:08 Job still running ...
2022/01/20 10:49:38 Job still running ...
2022/01/20 10:50:08 Job still running ...
2022/01/20 10:50:39 Job still running ...
2022/01/20 10:51:09 Job still running ...
2022/01/20 10:51:39 Failed to execute job: job 2022-01-20_02_47_37-8161018057026660740 failed
panic: Failed to execute job: job 2022-01-20_02_47_37-8161018057026660740 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143628, 0xc0000480b0, 0x1032402, 0x19, 0xc0002d1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ftzijk5ve6lek
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #396
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/396/display/redirect?page=changes>
Changes:
[mmack] [BEAM-8806] Integration test for SqsIO
[mmack] [BEAM-13631] Add deterministic SQS message coder to fix reading from SQS
[Robert Bradshaw] Bump beam container version.
[alexander.zhuravlev] [BEAM-13680] Fixed code_repository (added pipelineUuid to RunCodeResult
[Robert Bradshaw] Also bump FnAPI container.
[noreply] [BEAM-13616][BEAM-13645] Switch to vendored grpc 1.43.2 (#16543)
[noreply] [BEAM-13616][BEAM-13646] Upgrade vendored calcite to 1.28.0:0.2 (#16544)
[noreply] Merge pull request #16486 from [BEAM-13544][Playground] Add logs to
[noreply] [BEAM-13683] Correct SQL transform schema, fix expansion address
[noreply] Update walkthrough.md (#16512)
[noreply] [BEAM-11808][BEAM-9879] Support aggregate functions with two arguments
[noreply] Merge pull request #16506 from [BEAM-13652][Playground] Send examples'
[noreply] Merge pull request #16322 from [BEAM-13407] [Playground] Preload fonts
[noreply] [BEAM-13665] Make SpannerIO projectID optional again (#16547)
[noreply] [BEAM-13015] Add state caching capability to be used as hint for runners
[noreply] Merge pull request #16309: [BEAM-13503] Set a default value to
------------------------------------------
[...truncated 23.65 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/19 10:47:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642589249587503230/model
2022/01/19 10:47:31 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0119100328"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642589249587503230/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642589249587503230/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0119100328",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/19 10:47:31 Submitted job: 2022-01-19_02_47_31-383747923517086275
2022/01/19 10:47:31 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-19_02_47_31-383747923517086275?project=apache-beam-testing
2022/01/19 10:47:31 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-19_02_47_31-383747923517086275
2022/01/19 10:47:32 Job state: JOB_STATE_PENDING ...
2022/01/19 10:48:02 Job still running ...
2022/01/19 10:48:32 Job still running ...
2022/01/19 10:49:02 Job still running ...
2022/01/19 10:49:32 Job still running ...
2022/01/19 10:50:02 Job still running ...
2022/01/19 10:50:32 Job still running ...
2022/01/19 10:51:02 Failed to execute job: job 2022-01-19_02_47_31-383747923517086275 failed
panic: Failed to execute job: job 2022-01-19_02_47_31-383747923517086275 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143628, 0xc000120000, 0x1032402, 0x19, 0xc0003cde00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mnrl3k7pa6grq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #395
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/395/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13641][Playground]
[mmack] [BEAM-8806] Integration test for SqsIO using Localstack
[noreply] Remove jcenter repositories from gradle configuration. (#16532)
[noreply] [BEAM-13430] Remove jcenter which will no longer contain any updates.
[noreply] [BEAM-13616] Update com.google.cloud:libraries-bom to 24.2.0 (#16509)
------------------------------------------
[...truncated 23.68 KB...]
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/18 10:47:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642502860456426622/model
2022/01/18 10:47:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0118100321"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642502860456426622/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642502860456426622/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0118100321",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/18 10:47:41 Submitted job: 2022-01-18_02_47_41-15925689857794283163
2022/01/18 10:47:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-18_02_47_41-15925689857794283163?project=apache-beam-testing
2022/01/18 10:47:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-18_02_47_41-15925689857794283163
2022/01/18 10:47:41 Job state: JOB_STATE_PENDING ...
2022/01/18 10:48:11 Job still running ...
2022/01/18 10:48:42 Job still running ...
2022/01/18 10:49:12 Job still running ...
2022/01/18 10:49:42 Job still running ...
2022/01/18 10:50:12 Job still running ...
2022/01/18 10:50:42 Job still running ...
2022/01/18 10:51:12 Failed to execute job: job 2022-01-18_02_47_41-15925689857794283163 failed
panic: Failed to execute job: job 2022-01-18_02_47_41-15925689857794283163 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143628, 0xc0000480b0, 0x1032402, 0x19, 0xc000225e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/gljjnotrbcueo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #394
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/394/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #16507: [BEAM-13137] Fixes ES utest size flakiness
------------------------------------------
[...truncated 24.02 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/17 10:47:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642416460207526739/model
2022/01/17 10:47:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0117100327"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642416460207526739/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642416460207526739/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0117100327",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/17 10:47:41 Submitted job: 2022-01-17_02_47_40-17638690365271097014
2022/01/17 10:47:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-17_02_47_40-17638690365271097014?project=apache-beam-testing
2022/01/17 10:47:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-17_02_47_40-17638690365271097014
2022/01/17 10:47:41 Job state: JOB_STATE_PENDING ...
2022/01/17 10:48:11 Job still running ...
2022/01/17 10:48:41 Job still running ...
2022/01/17 10:49:11 Job still running ...
2022/01/17 10:49:41 Job still running ...
2022/01/17 10:50:11 Job still running ...
2022/01/17 10:50:42 Job still running ...
2022/01/17 10:51:12 Failed to execute job: job 2022-01-17_02_47_40-17638690365271097014 failed
panic: Failed to execute job: job 2022-01-17_02_47_40-17638690365271097014 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143628, 0xc00018a000, 0x1032402, 0x19, 0xc00056fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/27vrxlx6cfn24
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #393
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/393/display/redirect>
Changes:
------------------------------------------
[...truncated 23.97 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/16 10:47:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642330060292385986/model
2022/01/16 10:47:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0116100312"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642330060292385986/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642330060292385986/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0116100312",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/16 10:47:41 Submitted job: 2022-01-16_02_47_40-10832221114871236842
2022/01/16 10:47:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-16_02_47_40-10832221114871236842?project=apache-beam-testing
2022/01/16 10:47:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-16_02_47_40-10832221114871236842
2022/01/16 10:47:41 Job state: JOB_STATE_PENDING ...
2022/01/16 10:48:11 Job still running ...
2022/01/16 10:48:41 Job still running ...
2022/01/16 10:49:11 Job still running ...
2022/01/16 10:49:41 Job still running ...
2022/01/16 10:50:11 Job still running ...
2022/01/16 10:50:41 Job still running ...
2022/01/16 10:51:11 Failed to execute job: job 2022-01-16_02_47_40-10832221114871236842 failed
panic: Failed to execute job: job 2022-01-16_02_47_40-10832221114871236842 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143628, 0xc0000480b0, 0x1032402, 0x19, 0xc00044fe00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/6bczp7pnpkx5i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #392
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/392/display/redirect?page=changes>
Changes:
[daria.malkova] Split builder into several builder for each step of pipeline execution
[Valentyn Tymofieiev] Provide API to check whether a hint is known.
[Valentyn Tymofieiev] [BEAM-12558] Fix doc typo.
[arietis27] [BEAM-13400] JDBC IO does not support UUID and JSONB PostgreSQL types
[jrmccluskey] [BEAM-10206] Resolve go vet errors in protox package
[noreply] Merge pull request #16482 from [BEAM-13429][Playground] Add builder for
[noreply] [BEAM-13590] Fix abc imports from collections (#15850)
[jrmccluskey] Fix staticcheck errors in transforms directory
[jrmccluskey] Remove unnecessary fmt.Sprintf() in partition.go
[jrmccluskey] Replace bytes.Compare() with bytes.Equal() in test cases
[jrmccluskey] Replace string(buf.Bytes()) with buf.String() in coder_test.go
[jrmccluskey] Remove unnecessary blank identifier assignment in harness.go
[jrmccluskey] fix capitalized error strings in expansionx
[jrmccluskey] Clean up string cast of bytes in vet.go and corresponding tests
[jrmccluskey] Remove unnecessary fmt call in universal.go
[Robert Bradshaw] Remove tab from source.
[noreply] Redirecting cross-language transforms content (#16504)
[noreply] doc tweaks (#16498)
[noreply] [BEAM-12621] - Update Jenkins VMs to modern Ubuntu version (#16457)
[noreply] [BEAM-13664] Fix Primitives hashing benchmark (#16523)
------------------------------------------
[...truncated 24.17 KB...]
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/15 10:47:56 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642243675301636832/model
2022/01/15 10:47:56 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0115100323"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642243675301636832/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642243675301636832/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0115100323",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/15 10:47:56 Submitted job: 2022-01-15_02_47_56-7999346707663313685
2022/01/15 10:47:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-15_02_47_56-7999346707663313685?project=apache-beam-testing
2022/01/15 10:47:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-15_02_47_56-7999346707663313685
2022/01/15 10:47:57 Job state: JOB_STATE_PENDING ...
2022/01/15 10:48:27 Job still running ...
2022/01/15 10:48:57 Job still running ...
2022/01/15 10:49:27 Job still running ...
2022/01/15 10:49:57 Job still running ...
2022/01/15 10:50:27 Job still running ...
2022/01/15 10:50:57 Job still running ...
2022/01/15 10:51:27 Job still running ...
2022/01/15 10:51:57 Job still running ...
2022/01/15 10:52:27 Job still running ...
2022/01/15 10:52:57 Job still running ...
2022/01/15 10:53:27 Job still running ...
2022/01/15 10:53:57 Failed to execute job: job 2022-01-15_02_47_56-7999346707663313685 failed
panic: Failed to execute job: job 2022-01-15_02_47_56-7999346707663313685 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143628, 0xc0000480b0, 0x1032402, 0x19, 0xc0003f9e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 35s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/2difpkmyyav6s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #391
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/391/display/redirect?page=changes>
Changes:
[blais] python sdk examples: Fixed typo in wordcount example.
[noreply] [BEAM-13480] Increase pipeline timeout for
[noreply] Stronger typing inference for CoGBK. (#16465)
[noreply] [BEAM-12464] Change ProtoSchemaTranslator beam schema creation to match
[noreply] Introduce the notion of a JoinIndex for fewer shuffles. (#16101)
[noreply] Merge pull request #16467 from [BEAM-12164]: SpannerIO
[noreply] Merge pull request #16385 from [BEAM-13535] [Playground] add cancel
[noreply] Merge pull request #16485 from [BEAM-13486] [Playground] For unit tests
[heejong] [BEAM-13455] Remove duplicated artifacts when using multiple
[noreply] [BEAM-12572] Run java examples on multiple runners (#16450)
------------------------------------------
[...truncated 23.95 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/14 10:47:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642157258406101541/model
2022/01/14 10:47:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0114100325"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642157258406101541/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642157258406101541/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0114100325",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/14 10:47:39 Submitted job: 2022-01-14_02_47_39-10206089520785441741
2022/01/14 10:47:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-14_02_47_39-10206089520785441741?project=apache-beam-testing
2022/01/14 10:47:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-14_02_47_39-10206089520785441741
2022/01/14 10:47:39 Job state: JOB_STATE_PENDING ...
2022/01/14 10:48:09 Job still running ...
2022/01/14 10:48:39 Job still running ...
2022/01/14 10:49:09 Job still running ...
2022/01/14 10:49:39 Job still running ...
2022/01/14 10:50:09 Job still running ...
2022/01/14 10:50:39 Job still running ...
2022/01/14 10:51:10 Failed to execute job: job 2022-01-14_02_47_39-10206089520785441741 failed
panic: Failed to execute job: job 2022-01-14_02_47_39-10206089520785441741 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143628, 0xc0000480b0, 0x1032402, 0x19, 0xc0007c7e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/htqmsbikpdk4c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #390
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/390/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13638] Datatype of timestamp fields in SqsMessage for AWS IOs for
[noreply] Merge pull request #16469 from [BEAM-13623][Playground] [Bugfix] During
[noreply] Merge pull request #16149 from [BEAM-13113] [Playground] playground
[noreply] Merge pull request #16363 from [BEAM-13557] [Playground] show code
[noreply] Merge pull request #16374 from [BEAM-13398][Playground] Split LifeCycle
[noreply] [BEAM-13616][BEAM-13646] Update vendored calcite 1.28.0 with protobuf
[chamikaramj] Adds several example multi-language Python pipelines
[noreply] Merge pull request #16325 from [BEAM-13471] [Playground] Tag existing
[noreply] [BEAM-13399] Move service liveness polling to Runner type (#16487)
------------------------------------------
[...truncated 23.96 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/13 10:47:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642070874391303272/model
2022/01/13 10:47:55 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0113100319"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642070874391303272/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642070874391303272/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0113100319",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/13 10:47:55 Submitted job: 2022-01-13_02_47_55-4868579337977384407
2022/01/13 10:47:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-13_02_47_55-4868579337977384407?project=apache-beam-testing
2022/01/13 10:47:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-13_02_47_55-4868579337977384407
2022/01/13 10:47:55 Job state: JOB_STATE_PENDING ...
2022/01/13 10:48:25 Job still running ...
2022/01/13 10:48:56 Job still running ...
2022/01/13 10:49:26 Job still running ...
2022/01/13 10:49:56 Job still running ...
2022/01/13 10:50:26 Job still running ...
2022/01/13 10:50:56 Job still running ...
2022/01/13 10:51:26 Failed to execute job: job 2022-01-13_02_47_55-4868579337977384407 failed
panic: Failed to execute job: job 2022-01-13_02_47_55-4868579337977384407 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143628, 0xc000198000, 0x1032402, 0x19, 0xc00046be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 6s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qatib2m62exuy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #389
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/389/display/redirect?page=changes>
Changes:
[ningkang0957] [BEAM-13602] Prevented metrics gathering from failing bigtable io
[ningkang0957] make the code more pythonic
[mmack] [BEAM-13243][BEAM-8374] Add support for missing PublishResponse fields
[Robert Bradshaw] Optional args and kwargs for named external transforms.
[mmack] [adhoc] Run spotlessApply on java examples to fix master
[noreply] [BEAM-13628] Update SideInputCache to use full Transform and
[noreply] [BEAM-13432] Skip ExpansionService creation in Job Server (#16222)
[noreply] [BEAM-13616] Initial files for vendored gRPC 1.43.2 (#16460)
------------------------------------------
[...truncated 23.98 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/12 10:47:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641984458666183322/model
2022/01/12 10:47:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0112100310"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641984458666183322/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641984458666183322/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0112100310",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/12 10:47:39 Submitted job: 2022-01-12_02_47_39-11353877472007717307
2022/01/12 10:47:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-12_02_47_39-11353877472007717307?project=apache-beam-testing
2022/01/12 10:47:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-12_02_47_39-11353877472007717307
2022/01/12 10:47:39 Job state: JOB_STATE_PENDING ...
2022/01/12 10:48:10 Job still running ...
2022/01/12 10:48:40 Job still running ...
2022/01/12 10:49:10 Job still running ...
2022/01/12 10:49:40 Job still running ...
2022/01/12 10:50:10 Job still running ...
2022/01/12 10:50:40 Job still running ...
2022/01/12 10:51:10 Failed to execute job: job 2022-01-12_02_47_39-11353877472007717307 failed
panic: Failed to execute job: job 2022-01-12_02_47_39-11353877472007717307 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143628, 0xc00018a000, 0x1032402, 0x19, 0xc000887e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wabvrcd3so3sy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #388
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/388/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.106
[relax] don't close streams in finalize
[noreply] Loosen typing extensions bound
[Alexey Romanenko] [BEAM-4868] Bump com.amazonaws to 1.12.135
[noreply] [BEAM-12092] Bump jedis to version 4.0.1 (#16287)
[noreply] [BEAM-13534] Add automated port polling to expansion service runner if
[noreply] Merge pull request #16344 from [BEAM-13536][Playground][Bugfix] CI step
[noreply] Merge pull request #16359 from [BEAM-13545][Playground] Add
[noreply] Merge pull request #16384 from [BEAM-13308] [Playground] Getting
[noreply] Merge pull request #16306 from [BEAM-13447] [Playground] Add filling of
[noreply] Merge pull request #16361 from [BEAM-13543][Playground] Add logic of
[noreply] [BEAM-12562] Dataframe pipe implementation (#16256)
[noreply] Merge pull request #16338 from [BEAM-13528][Playground] Add liveness
[noreply] [BEAM-13626] Remap expanded outputs after merging. (#16471)
[noreply] Merge pull request #16147 from [BEAM-13359] [Playground] Tag existing
[noreply] [BEAM-3221] Improve documentation in model pipeline protos (#16474)
[noreply] [BEAM-13614] Add OnWindowExpiration support to the Java SDK harness and
[noreply] Merge pull request #16156 from [BEAM-13391] Fix temporary file format in
------------------------------------------
[...truncated 24.09 KB...]
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/11 10:47:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641898052372995714/model
2022/01/11 10:47:32 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0111100310"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641898052372995714/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641898052372995714/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0111100310",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/11 10:47:33 Submitted job: 2022-01-11_02_47_32-10065117167427399201
2022/01/11 10:47:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-11_02_47_32-10065117167427399201?project=apache-beam-testing
2022/01/11 10:47:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-11_02_47_32-10065117167427399201
2022/01/11 10:47:33 Job state: JOB_STATE_PENDING ...
2022/01/11 10:48:03 Job still running ...
2022/01/11 10:48:33 Job still running ...
2022/01/11 10:49:03 Job still running ...
2022/01/11 10:49:33 Job still running ...
2022/01/11 10:50:04 Job still running ...
2022/01/11 10:50:34 Job still running ...
2022/01/11 10:51:04 Job still running ...
2022/01/11 10:51:34 Job still running ...
2022/01/11 10:52:04 Job still running ...
2022/01/11 10:52:34 Job still running ...
2022/01/11 10:53:04 Job still running ...
2022/01/11 10:53:34 Failed to execute job: job 2022-01-11_02_47_32-10065117167427399201 failed
panic: Failed to execute job: job 2022-01-11_02_47_32-10065117167427399201 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11422a8, 0xc000120000, 0x10311e2, 0x19, 0xc000857e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 13s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/uhpobbsdzc3yy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #387
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/387/display/redirect>
Changes:
------------------------------------------
[...truncated 23.95 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/10 10:47:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641811658051315079/model
2022/01/10 10:47:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0110100307"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641811658051315079/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641811658051315079/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0110100307",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/10 10:47:39 Submitted job: 2022-01-10_02_47_38-1161085432717549171
2022/01/10 10:47:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-10_02_47_38-1161085432717549171?project=apache-beam-testing
2022/01/10 10:47:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-10_02_47_38-1161085432717549171
2022/01/10 10:47:39 Job state: JOB_STATE_PENDING ...
2022/01/10 10:48:09 Job still running ...
2022/01/10 10:48:39 Job still running ...
2022/01/10 10:49:09 Job still running ...
2022/01/10 10:49:39 Job still running ...
2022/01/10 10:50:09 Job still running ...
2022/01/10 10:50:39 Job still running ...
2022/01/10 10:51:09 Failed to execute job: job 2022-01-10_02_47_38-1161085432717549171 failed
panic: Failed to execute job: job 2022-01-10_02_47_38-1161085432717549171 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11422a8, 0xc0000480b0, 0x10311e2, 0x19, 0xc000401e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7x3cxarpi75yk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #386
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/386/display/redirect>
Changes:
------------------------------------------
[...truncated 23.97 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/09 10:47:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641725258955037910/model
2022/01/09 10:47:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0109100321"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641725258955037910/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641725258955037910/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0109100321",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/09 10:47:40 Submitted job: 2022-01-09_02_47_39-4271099295611757744
2022/01/09 10:47:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-09_02_47_39-4271099295611757744?project=apache-beam-testing
2022/01/09 10:47:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-09_02_47_39-4271099295611757744
2022/01/09 10:47:40 Job state: JOB_STATE_PENDING ...
2022/01/09 10:48:10 Job still running ...
2022/01/09 10:48:40 Job still running ...
2022/01/09 10:49:10 Job still running ...
2022/01/09 10:49:40 Job still running ...
2022/01/09 10:50:10 Job still running ...
2022/01/09 10:50:40 Job still running ...
2022/01/09 10:51:10 Failed to execute job: job 2022-01-09_02_47_39-4271099295611757744 failed
panic: Failed to execute job: job 2022-01-09_02_47_39-4271099295611757744 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11422a8, 0xc0000480b0, 0x10311e2, 0x19, 0xc00001be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/yygi2fxr7p43w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #385
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/385/display/redirect?page=changes>
Changes:
[Alexey Romanenko] [adhoc] Fix BigTableIO description
[noreply] [BEAM-13015] Remove dead code now that all instances have migrated to
[noreply] [BEAM-13386] Add RLock support for cloudpickle (#16250)
[danthev] Fix overflow
------------------------------------------
[...truncated 23.89 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/08 10:47:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641638849104250548/model
2022/01/08 10:47:29 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0108100315"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641638849104250548/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641638849104250548/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0108100315",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/08 10:47:30 Submitted job: 2022-01-08_02_47_29-18371244795000021421
2022/01/08 10:47:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-08_02_47_29-18371244795000021421?project=apache-beam-testing
2022/01/08 10:47:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-08_02_47_29-18371244795000021421
2022/01/08 10:47:30 Job state: JOB_STATE_PENDING ...
2022/01/08 10:48:00 Job still running ...
2022/01/08 10:48:30 Job still running ...
2022/01/08 10:49:00 Job still running ...
2022/01/08 10:49:30 Job still running ...
2022/01/08 10:50:00 Job still running ...
2022/01/08 10:50:31 Job still running ...
2022/01/08 10:51:01 Failed to execute job: job 2022-01-08_02_47_29-18371244795000021421 failed
panic: Failed to execute job: job 2022-01-08_02_47_29-18371244795000021421 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11422a8, 0xc0000480b0, 0x10311e2, 0x19, 0xc000407e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 40s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pyij6iyldgvvy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #384
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/384/display/redirect?page=changes>
Changes:
[heejong] [BEAM-13091] Generate missing staged names from hash for Dataflow runner
[heejong] add test
[arietis27] [BEAM-13604] NPE while getting null from BigDecimal column
[noreply] Fixed empty labels treated as wildcard when matching cache files
[noreply] [BEAM-13570] Remove erroneous compileClasspath dependency. (#16438)
[noreply] [BEAM-13015] Plumb through process wide and bundle cache through the
[noreply] [BEAM-13015] Cache the state backed iterable used for large GBK results.
[noreply] Fix formatting/alignment (#16443)
[noreply] Merge pull request #16183 from [BEAM-13427] [Playground] show logs for
[noreply] [BEAM-10277] re-write encoding position tests to declare schema protos
[noreply] Update local_env_tests.yml (#16444)
[noreply] [BEAM-13574] Filesystem abstraction Rename support (#16428)
[noreply] [BEAM-13597] Setup Go in github actions (#16446)
[noreply] Merge pull request #16161 from [BEAM-12164] Add Spanner Partition
[noreply] Merge pull request #16203 from [BEAM-12164] Add Spanner Change Stream
------------------------------------------
[...truncated 23.97 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/07 10:47:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641552460302243535/model
2022/01/07 10:47:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0107100321"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641552460302243535/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641552460302243535/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0107100321",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/07 10:47:41 Submitted job: 2022-01-07_02_47_40-15282469979483179614
2022/01/07 10:47:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-07_02_47_40-15282469979483179614?project=apache-beam-testing
2022/01/07 10:47:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-07_02_47_40-15282469979483179614
2022/01/07 10:47:41 Job state: JOB_STATE_PENDING ...
2022/01/07 10:48:11 Job still running ...
2022/01/07 10:48:41 Job still running ...
2022/01/07 10:49:11 Job still running ...
2022/01/07 10:49:42 Job still running ...
2022/01/07 10:50:12 Job still running ...
2022/01/07 10:50:42 Job still running ...
2022/01/07 10:51:12 Failed to execute job: job 2022-01-07_02_47_40-15282469979483179614 failed
panic: Failed to execute job: job 2022-01-07_02_47_40-15282469979483179614 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11422a8, 0xc0000480b0, 0x10311e2, 0x19, 0xc000373e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5arfxb7prnqlc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #383
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/383/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13565][Playground]
[relax] update bom
[zyichi] Upgrade python library versions in base_image_requirements.txt
[noreply] [BEAM-13567] Consolidate runner flag definition. (#16426)
[noreply] [BEAM-13601] Don't cache Row types for a schema. (#16427)
[noreply] [BEAM-13430] Re-enable checkerframework (#16429)
[noreply] [BEAM-13430] Ensure that testRuntimeMigration depends on "default"
[noreply] Merge pull request #16277 from [BEAM-13124][Playground] Create readiness
[noreply] Merge pull request #16314 from [BEAM-13260][Playground]Implement setup
[noreply] Merge pull request #16383 from [BEAM-13566][Playground] Add logic of
[noreply] Merge pull request #16365 from [BEAM-13559][Playground] Remove tag in
[noreply] Merge pull request #16360 from [BEAM-13546][Playground] Update nginx
[noreply] Merge pull request #16192 from [BEAM-13395] [Playground] Tag katas
[noreply] Merge pull request #16254 from [BEAM-13249][Playground] Security – Mock
[ningkang0957] [BEAM-12879] Prevented missing permission from failing GCS I/O
[noreply] Merge pull request #16347: fix: move connector to use v1 BigQuery
[noreply] [BEAM-13603] Fix bug in apache_beam.utils.Shared (#16437)
[noreply] [BEAM-10345] Add an import guard to support recent google-cloud-spanner
------------------------------------------
[...truncated 24.01 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/06 10:47:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641466059729230216/model
2022/01/06 10:47:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0106100322"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641466059729230216/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641466059729230216/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0106100322",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/06 10:47:42 Submitted job: 2022-01-06_02_47_40-13120030649342962950
2022/01/06 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-06_02_47_40-13120030649342962950?project=apache-beam-testing
2022/01/06 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-06_02_47_40-13120030649342962950
2022/01/06 10:47:42 Job state: JOB_STATE_PENDING ...
2022/01/06 10:48:12 Job still running ...
2022/01/06 10:48:42 Job still running ...
2022/01/06 10:49:12 Job still running ...
2022/01/06 10:49:42 Job still running ...
2022/01/06 10:50:12 Job still running ...
2022/01/06 10:50:42 Job still running ...
2022/01/06 10:51:12 Failed to execute job: job 2022-01-06_02_47_40-13120030649342962950 failed
panic: Failed to execute job: job 2022-01-06_02_47_40-13120030649342962950 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140f08, 0xc000120000, 0x103011c, 0x19, 0xc00056de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ca
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qaruhtwobch3w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #382
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/382/display/redirect?page=changes>
Changes:
[johnjcasey] [BEAM-12391] update avro sink to close the opened file handle, instead
[Robert Bradshaw] [BEAM-13482] Python fully qualified name external transforms.
[Robert Bradshaw] Add Python expansion service entry point.
[Kyle Weaver] [BEAM-13569] Change Spark dependencies to implementation.
[Kyle Weaver] remove redundant dependency
[wuren] [BEAM-13591] Bump log4j2 version to 2.17.1
[Steve Niemitz] [BEAM-13459] Update CHANGES.md, add note about artifact caching for
[relax] Add Flink runner support for OrderedListState. This version reads the
[noreply] Merge pull request #16404: [BEAM-13586] Fix NPE in
[zyichi] Fix sdk_container_builder too many values to unpack error
[noreply] [BEAM-13480] Sickbay PubSubIntegrationTest.test_streaming_data_only on
[Kyle Weaver] remove redundant testImplementation dependencies
[noreply] [BEAM-13430] Swap to use "mainClass" instead of "main" since it was
[zyichi] Fix remaining failing perf IT tests.
[noreply] [BEAM-13430] Replace deprecated "appendix" with "archiveAppendix"
[noreply] [BEAM-13015] Add jamm as a java agent to the Java SDK harness container
[noreply] [BEAM-13430] Partially revert
[noreply] Merge pull request #15863 from [BEAM-13184] Autosharding for
[noreply] [BEAM-11936] Enable FloatingPointAssertionWithinEpsilon errorprone check
[noreply] [BEAM-11936] Enable LockNotBeforeTry errorprone check (#16259)
[noreply] [BEAM-11936] Enable errorprone unused checks (#16262)
[noreply] Add Nexmark Query 14 (#16337)
[noreply] [BEAM-13015] Migrate all user state and side implementations to support
[noreply] [BEAM-13015] Use 20% of memory when the maximum has been configured.
------------------------------------------
[...truncated 24.02 KB...]
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/05 10:47:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641379661481446916/model
2022/01/05 10:47:42 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0105100321"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641379661481446916/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641379661481446916/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0105100321",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/05 10:47:42 Submitted job: 2022-01-05_02_47_42-813902043073410217
2022/01/05 10:47:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-05_02_47_42-813902043073410217?project=apache-beam-testing
2022/01/05 10:47:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-05_02_47_42-813902043073410217
2022/01/05 10:47:42 Job state: JOB_STATE_PENDING ...
2022/01/05 10:48:13 Job still running ...
2022/01/05 10:48:43 Job still running ...
2022/01/05 10:49:13 Job still running ...
2022/01/05 10:49:43 Job still running ...
2022/01/05 10:50:13 Job still running ...
2022/01/05 10:50:43 Job still running ...
2022/01/05 10:51:13 Job still running ...
2022/01/05 10:51:43 Failed to execute job: job 2022-01-05_02_47_42-813902043073410217 failed
panic: Failed to execute job: job 2022-01-05_02_47_42-813902043073410217 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140f08, 0xc0000480b0, 0x103011c, 0x19, 0xc000761e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ea
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/walwy7ojl3l44
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #381
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/381/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13509] Stop sharing SQS client between readers of same source.
[mmack] [BEAM-13587] Attempt to load AWS region from default provider chain in
------------------------------------------
[...truncated 23.99 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/04 10:47:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641293256038781378/model
2022/01/04 10:47:36 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0104100319"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641293256038781378/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641293256038781378/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0104100319",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/04 10:47:37 Submitted job: 2022-01-04_02_47_36-4261565340385451891
2022/01/04 10:47:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-04_02_47_36-4261565340385451891?project=apache-beam-testing
2022/01/04 10:47:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-04_02_47_36-4261565340385451891
2022/01/04 10:47:37 Job state: JOB_STATE_PENDING ...
2022/01/04 10:48:07 Job still running ...
2022/01/04 10:48:37 Job still running ...
2022/01/04 10:49:07 Job still running ...
2022/01/04 10:49:37 Job still running ...
2022/01/04 10:50:07 Job still running ...
2022/01/04 10:50:37 Job still running ...
2022/01/04 10:51:07 Failed to execute job: job 2022-01-04_02_47_36-4261565340385451891 failed
panic: Failed to execute job: job 2022-01-04_02_47_36-4261565340385451891 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140f08, 0xc0000480b0, 0x103011c, 0x19, 0xc00040be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ea
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/46dfzsp2udrtc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #380
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/380/display/redirect>
Changes:
------------------------------------------
[...truncated 24.19 KB...]
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/03 10:47:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641206858293505930/model
2022/01/03 10:47:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0103100317"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641206858293505930/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641206858293505930/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0103100317",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/03 10:47:39 Submitted job: 2022-01-03_02_47_38-8844137482013793629
2022/01/03 10:47:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-03_02_47_38-8844137482013793629?project=apache-beam-testing
2022/01/03 10:47:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-03_02_47_38-8844137482013793629
2022/01/03 10:47:39 Job state: JOB_STATE_PENDING ...
2022/01/03 10:48:09 Job still running ...
2022/01/03 10:48:39 Job still running ...
2022/01/03 10:49:09 Job still running ...
2022/01/03 10:49:39 Job still running ...
2022/01/03 10:50:09 Job still running ...
2022/01/03 10:50:39 Job still running ...
2022/01/03 10:51:10 Job still running ...
2022/01/03 10:51:40 Job still running ...
2022/01/03 10:52:10 Job still running ...
2022/01/03 10:52:40 Job still running ...
2022/01/03 10:53:10 Job still running ...
2022/01/03 10:53:40 Failed to execute job: job 2022-01-03_02_47_38-8844137482013793629 failed
panic: Failed to execute job: job 2022-01-03_02_47_38-8844137482013793629 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140f08, 0xc0000480b0, 0x103011c, 0x19, 0xc000177e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ea
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ugonfard3mspo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #379
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/379/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13498, BEAM-13522] Sickbay broken test and test category for Spark
------------------------------------------
[...truncated 24.02 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/02 14:12:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641132760089768645/model
2022/01/02 14:12:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0102135216"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641132760089768645/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641132760089768645/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0102135216",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/02 14:12:41 Submitted job: 2022-01-02_06_12_40-987759019283919270
2022/01/02 14:12:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-02_06_12_40-987759019283919270?project=apache-beam-testing
2022/01/02 14:12:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-02_06_12_40-987759019283919270
2022/01/02 14:12:41 Job state: JOB_STATE_PENDING ...
2022/01/02 14:13:11 Job still running ...
2022/01/02 14:13:41 Job still running ...
2022/01/02 14:14:11 Job still running ...
2022/01/02 14:14:41 Job still running ...
2022/01/02 14:15:11 Job still running ...
2022/01/02 14:15:41 Job still running ...
2022/01/02 14:16:11 Failed to execute job: job 2022-01-02_06_12_40-987759019283919270 failed
panic: Failed to execute job: job 2022-01-02_06_12_40-987759019283919270 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140f08, 0xc000120000, 0x103011c, 0x19, 0xc0000c1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ea
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 42s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/eeitm7b7szqbq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #378
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/378/display/redirect?page=changes>
Changes:
[stranniknm] [BEAM-13555] playground - quick fix for safari
[noreply] Merge pull request #15769 from [BEAM-13031] [Playground] Code editor -
[noreply] [BEAM-13541] Fix spotbugs issue with DLS in tail (#16407)
[noreply] [BEAM-13588] Add missing module for PVR tests and also sickbay known
[noreply] [BEAM-13575] Sickbay test that is flaky to restore precommit test signal
[noreply] [BEAM-12092] Bump jedis to version 3.8.0 (#16403)
------------------------------------------
[...truncated 23.94 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/01 10:47:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641034060307861824/model
2022/01/01 10:47:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-0101100320"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641034060307861824/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641034060307861824/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-0101100320",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/01/01 10:47:41 Submitted job: 2022-01-01_02_47_41-5583201050788002549
2022/01/01 10:47:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-01_02_47_41-5583201050788002549?project=apache-beam-testing
2022/01/01 10:47:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-01_02_47_41-5583201050788002549
2022/01/01 10:47:41 Job state: JOB_STATE_PENDING ...
2022/01/01 10:48:11 Job still running ...
2022/01/01 10:48:41 Job still running ...
2022/01/01 10:49:11 Job still running ...
2022/01/01 10:49:41 Job still running ...
2022/01/01 10:50:11 Job still running ...
2022/01/01 10:50:41 Job still running ...
2022/01/01 10:51:12 Failed to execute job: job 2022-01-01_02_47_41-5583201050788002549 failed
panic: Failed to execute job: job 2022-01-01_02_47_41-5583201050788002549 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140f08, 0xc0000480b0, 0x103011c, 0x19, 0xc0003ede00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ea
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ac7k2qi5mknuu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #377
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/377/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13009] Fix tests to ensure absence of duplicates only per request
[mmack] [adhoc] Use predefined min/max combiners in SQS reader to gather stats
[zyichi] Fix class not found in perf integration tests.
[noreply] Update
[noreply] [BEAM-13430] Fix class not found error for example integration tests and
[noreply] [BEAM-13430] Re-enable dependency analysis for modules. (#16395)
[noreply] [BEAM-13484][Playground] Improve Terraform Scripts For Deploy
[noreply] [BEAM-13541] More intelligent caching of CoGBK values. (#16354)
------------------------------------------
[...truncated 23.96 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/31 10:47:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640947665149385555/model
2021/12/31 10:47:45 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-1231100315"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640947665149385555/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640947665149385555/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-1231100315",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/31 10:47:46 Submitted job: 2021-12-31_02_47_45-124463328332190062
2021/12/31 10:47:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-31_02_47_45-124463328332190062?project=apache-beam-testing
2021/12/31 10:47:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-31_02_47_45-124463328332190062
2021/12/31 10:47:46 Job state: JOB_STATE_PENDING ...
2021/12/31 10:48:16 Job still running ...
2021/12/31 10:48:46 Job still running ...
2021/12/31 10:49:16 Job still running ...
2021/12/31 10:49:46 Job still running ...
2021/12/31 10:50:16 Job still running ...
2021/12/31 10:50:46 Job still running ...
2021/12/31 10:51:16 Failed to execute job: job 2021-12-31_02_47_45-124463328332190062 failed
panic: Failed to execute job: job 2021-12-31_02_47_45-124463328332190062 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140f08, 0xc0000480b0, 0x103011c, 0x19, 0xc00040be00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ea
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 56s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vp3mjpkaqbe4q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #376
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/376/display/redirect?page=changes>
Changes:
[Steve Niemitz] [BEAM-13488] Work around bug in classpath detection
[noreply] [BEAM-13578] Validate that repeatable PipelineOptions need to be
[noreply] [BEAM-13430] Update comment over eclipse plugin. (#16387)
[zyichi] [BEAM-13430] Fix broken ULR validates runner tests
[noreply] Update venv creation commands in release scripts. (#16381)
[Steve Niemitz] [BEAM-13459] Cache artifacts across job runs on python+dataflow
[noreply] [BEAM-12777] Stable URL for current API docs (#16327)
[noreply] [BEAM-13539] correct resource override dependencies (#16392)
[Kyle Weaver] [BEAM-13581] Remove previous job name for Flink PVR precommit.
[emilyye] Moving to 2.37.0-SNAPSHOT on master branch.
[noreply] Release website update for Beam 2.35.0 (#16115)
[noreply] [BEAM-13430] Re-enable checkerframework for the project excluding the
------------------------------------------
[...truncated 24.01 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/30 10:47:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640861274114433020/model
2021/12/30 10:47:54 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-1230100306"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.37.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640861274114433020/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.37.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640861274114433020/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.37.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-1230100306",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/30 10:47:56 Submitted job: 2021-12-30_02_47_54-6956550041396710354
2021/12/30 10:47:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-30_02_47_54-6956550041396710354?project=apache-beam-testing
2021/12/30 10:47:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-30_02_47_54-6956550041396710354
2021/12/30 10:47:56 Job state: JOB_STATE_PENDING ...
2021/12/30 10:48:26 Job still running ...
2021/12/30 10:48:56 Job still running ...
2021/12/30 10:49:26 Job still running ...
2021/12/30 10:49:56 Job still running ...
2021/12/30 10:50:26 Job still running ...
2021/12/30 10:50:56 Job still running ...
2021/12/30 10:51:26 Failed to execute job: job 2021-12-30_02_47_54-6956550041396710354 failed
panic: Failed to execute job: job 2021-12-30_02_47_54-6956550041396710354 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140f08, 0xc000128000, 0x103011c, 0x19, 0xc00066de00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ea
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 4s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5csk2of5dqq6k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_ParDo_Dataflow_Batch #375
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/375/display/redirect?page=changes>
Changes:
[dpcollins] [BEAM-13402] Simplify PubsubLiteSink
[Kyle Weaver] [BEAM-13521] flink pvr batch precommit
[Kyle Weaver] [BEAM-13571] Fix ClassNotFound exception in Flink tests
[Kyle Weaver] [BEAM-13498] [BEAM-13573] exclude new tests on Flink
[noreply] Exclude UsesOnWindowExpiration by category from Dataflow v2 streaming
[noreply] [BEAM-13052] Increment pubsub python version and fix breakages. (#16126)
[noreply] [BEAM-13052] Add Pub/Sub Lite xlang transforms in python (#15727)
[noreply] [BEAM-13402] Version bump Pub/Sub Lite and implement changes to ensure
------------------------------------------
[...truncated 23.96 KB...]
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_****_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006****"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "e8"
root_transform_ids: "e9"
root_transform_ids: "e10"
root_transform_ids: "e11"
root_transform_ids: "e12"
root_transform_ids: "e13"
root_transform_ids: "e14"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2021/12/29 10:47:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1640774872682154110/model
2021/12/29 10:47:53 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-pardo-1-1229100316"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.36.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}"
},
{
"key": "number_of_counters",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_pardo_1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "iterations",
"namespace": "go_options",
"type": "STRING",
"value": "10"
},
{
"key": "number_of_counter_operations",
"namespace": "go_options",
"type": "STRING",
"value": "0"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/pardo"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640774872682154110/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_pardo_1",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90}",
"iterations": "10",
"number_of_counter_operations": "0",
"number_of_counters": "0",
"****_binary": "linux_amd64/pardo"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.36.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 5,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1640774872682154110/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.36.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.36.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-pardo-1-1229100316",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/12/29 10:47:54 Submitted job: 2021-12-29_02_47_53-7346264800463837610
2021/12/29 10:47:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2021-12-29_02_47_53-7346264800463837610?project=apache-beam-testing
2021/12/29 10:47:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-12-29_02_47_53-7346264800463837610
2021/12/29 10:47:54 Job state: JOB_STATE_PENDING ...
2021/12/29 10:48:24 Job still running ...
2021/12/29 10:48:54 Job still running ...
2021/12/29 10:49:24 Job still running ...
2021/12/29 10:49:54 Job still running ...
2021/12/29 10:50:24 Job still running ...
2021/12/29 10:50:54 Job still running ...
2021/12/29 10:51:24 Failed to execute job: job 2021-12-29_02_47_53-7346264800463837610 failed
panic: Failed to execute job: job 2021-12-29_02_47_53-7346264800463837610 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1140f08, 0xc000120000, 0x103011c, 0x19, 0xc0003f1e00, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/pardo/pardo.go>:105 +0x3ea
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_ParDo_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 1s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qj4crvivkkd62
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org