You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/04/21 11:18:14 UTC
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #485
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/485/display/redirect?page=changes>
Changes:
[vachan] Annotating Read API tests.
[bulat.safiullin] [BEAM-14247] [Website] add image
[bulat.safiullin] [BEAM-14247] [Website] center image
[mattcasters] BEAM-1857 : CHANGES.md entry for 2.38.0
[mmack] [BEAM-14323] Improve IDE integration of Spark cross version builds
[noreply] [BEAM-14112] Fixed ReadFromBigQuery with Interactive Beam (#17306)
[noreply] Update .asf.yaml (#17409)
[noreply] [BEAM-14336] Sickbay flight delays test - dataset seems to be missing
[noreply] [BEAM-14338] Update watermark unit tests to use time.Time.Equals()
[noreply] [BEAM-14328] Tweaks to "Differences from pandas" page (#17413)
[Andrew Pilloud] [BEAM-14253] Disable broken test pending Dataflow fix
[yiru] fix: BigQuery Storage Connector trace id population missing bracket
[noreply] [BEAM-14330] Temporarily disable the clusters auto-cleanup (#17400)
[noreply] Update Beam website to release 2.38.0 (#17378)
[noreply] [BEAM-14213] Add API and construction time validation for Batched DoFns
[noreply] Minor: Update release guide regarding archive.apache.org (#17419)
[noreply] [BEAM-14017] beam_PreCommit_CommunityMetrics_Cron test failing (#17396)
------------------------------------------
[...truncated 17.07 KB...]
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c4"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650539679532001462/****\022@85cb4928dc4516be66bc50d48050ce560243201f536b5f6ec849c9d9a1e57419"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/21 11:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650539679532001462/model
2022/04/21 11:14:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0421100434"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650539679532001462/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650539679532001462/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0421100434",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/21 11:14:42 Submitted job: 2022-04-21_04_14_40-5798457102032017459
2022/04/21 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-21_04_14_40-5798457102032017459?project=apache-beam-testing
2022/04/21 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-21_04_14_40-5798457102032017459
2022/04/21 11:14:42 Job state: JOB_STATE_PENDING ...
2022/04/21 11:15:12 Job still running ...
2022/04/21 11:15:42 Job still running ...
2022/04/21 11:16:12 Job still running ...
2022/04/21 11:16:42 Job still running ...
2022/04/21 11:17:12 Job still running ...
2022/04/21 11:17:42 Job still running ...
2022/04/21 11:18:12 Failed to execute job: job 2022-04-21_04_14_40-5798457102032017459 failed
panic: Failed to execute job: job 2022-04-21_04_14_40-5798457102032017459 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030a8, 0xc000120000, 0x10e1a7b, 0x19, 0xc000413df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tldrul5vmunyq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_LoadTests_Go_SideInput_Dataflow_Batch #501
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/501/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #500
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/500/display/redirect?page=changes>
Changes:
[zyichi] Move master readme.md to 2.40.0
[noreply] [BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink
------------------------------------------
[...truncated 17.53 KB...]
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c5"
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651770393262002459/****\022@965e0bb55b25907cfa423dd63625577fd640a0171a3b81f50cb1e4c273f470ec"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 17:06:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651770393262002459/model
2022/05/05 17:06:33 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0505150443"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.40.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770393262002459/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.40.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770393262002459/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.40.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0505150443",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/05 17:06:34 Submitted job: 2022-05-05_10_06_34-8125495731363788730
2022/05/05 17:06:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_10_06_34-8125495731363788730?project=apache-beam-testing
2022/05/05 17:06:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_10_06_34-8125495731363788730
2022/05/05 17:06:34 Job state: JOB_STATE_PENDING ...
2022/05/05 17:07:04 Job still running ...
2022/05/05 17:07:34 Job still running ...
2022/05/05 17:08:04 Job still running ...
2022/05/05 17:08:34 Job still running ...
2022/05/05 17:09:04 Job still running ...
2022/05/05 17:09:35 Failed to execute job: job 2022-05-05_10_06_34-8125495731363788730 failed
panic: Failed to execute job: job 2022-05-05_10_06_34-8125495731363788730 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231ce8, 0xc0000480c0, 0x110ea7a, 0x19, 0xc00041de68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:92 +0x471
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 25s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/lbffyaomyvaiu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #499
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/499/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-9245] Unable to pull datatore Entity which contains dict
[bulat.safiullin] [BEAM-14382] [Website] add banner container for with css, images, html
[Jan Lukavský] [BEAM-14196] add test verifying output watermark propagation in bundle
[Jan Lukavský] [BEAM-14196] Fix FlinkRunner mid-bundle output watermark handling
[nielm] [BEAM-14405] Fix NPE when ProjectID is not specified in a template
[bulat.safiullin] [BEAM-14382] change mobile banner img, add padding to banner section
[ahmedabualsaud] fix test decotrator typo
[noreply] Merge pull request #17440 from [BEAM-14329] Enable exponential backoff
[noreply] [BEAM-11104] Fix output forwarding issue for ProcessContinuations
[noreply] re-add testing package to pydoc (#17524)
[Heejong Lee] add test
[noreply] [BEAM-14250] Amended the workaround (#17531)
[noreply] [BEAM-11104] Fix broken split result validation (#17546)
[noreply] Fixed a SQL and screenshots in the Beam SQL blog (#17545)
[noreply] Merge pull request #17417: [BEAM-14388] Address some performance
[noreply] [BEAM-14386] [Flink] Support for scala 2.12 (#17512)
[noreply] [BEAM-14294] Worker changes to support trivial Batched DoFns (#17384)
[zyichi] Moving to 2.40.0-SNAPSHOT on master branch.
[noreply] [BEAM-14048] [CdapIO] Add ConfigWrapper for building CDAP PluginConfigs
------------------------------------------
[...truncated 17.35 KB...]
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c5"
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651749303377555240/****\022@8b5200c424addfeb22f0ea76b779b4694bfd6e95d0c22a38b3992e1016522c8b"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 11:15:04 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651749303377555240/model
2022/05/05 11:15:04 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0505100411"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.40.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651749303377555240/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.40.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651749303377555240/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.40.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0505100411",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/05 11:15:04 Submitted job: 2022-05-05_04_15_04-18243073991136963016
2022/05/05 11:15:04 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_04_15_04-18243073991136963016?project=apache-beam-testing
2022/05/05 11:15:04 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_04_15_04-18243073991136963016
2022/05/05 11:15:04 Job state: JOB_STATE_PENDING ...
2022/05/05 11:15:34 Job still running ...
2022/05/05 11:16:04 Job still running ...
2022/05/05 11:16:34 Job still running ...
2022/05/05 11:17:04 Job still running ...
2022/05/05 11:17:34 Job still running ...
2022/05/05 11:18:05 Failed to execute job: job 2022-05-05_04_15_04-18243073991136963016 failed
panic: Failed to execute job: job 2022-05-05_04_15_04-18243073991136963016 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231c88, 0xc0000480c0, 0x110ea1a, 0x19, 0xc0006ebe68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ccognekwjayac
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #498
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/498/display/redirect?page=changes>
Changes:
[noreply] fix: JDBC config schema fields order
[Brian Hulette] Revert "Merge pull request #17255 from kileys/test-revert"
[Brian Hulette] BEAM-14231: bypass schema cache for
[noreply] [BEAM-13657] Follow up update version warning in __init__ (#17493)
[noreply] Merge pull request #17431 from [BEAM-14273] Add integration tests for BQ
[noreply] Merge pull request #17205 from [BEAM-14145] [Website] add carousel to
[noreply] [BEAM-14064] fix es io windowing (#17112)
[noreply] [BEAM-13670] Upgraded ipython from v7 to v8 (#17529)
[noreply] [BEAM-11104] Enable ProcessContinuation return values, add unit test
[Robert Bradshaw] [BEAM-14403] Allow Prime to be used with legacy workers.
[noreply] [BEAM-11106] Support drain in Go SDK (#17432)
[noreply] add __Init__ to inference. (#17514)
------------------------------------------
[...truncated 17.29 KB...]
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c5"
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651662883556773094/****\022@730b6467ef232e5fc6b39140457e9af03e8b89e09fa666f0f0713858f3fc70f1"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/04 11:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651662883556773094/model
2022/05/04 11:14:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651662883556773094/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651662883556773094/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/04 11:14:44 Submitted job: 2022-05-04_04_14_44-11675152796227470620
2022/05/04 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-04_04_14_44-11675152796227470620?project=apache-beam-testing
2022/05/04 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-04_04_14_44-11675152796227470620
2022/05/04 11:14:45 Job state: JOB_STATE_PENDING ...
2022/05/04 11:15:15 Job still running ...
2022/05/04 11:15:45 Job still running ...
2022/05/04 11:16:15 Job still running ...
2022/05/04 11:16:45 Job still running ...
2022/05/04 11:17:15 Job still running ...
2022/05/04 11:17:45 Failed to execute job: job 2022-05-04_04_14_44-11675152796227470620 failed
panic: Failed to execute job: job 2022-05-04_04_14_44-11675152796227470620 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231c88, 0xc000120000, 0x110ea1a, 0x19, 0xc000363e68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/4nrs363myodjy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #497
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/497/display/redirect?page=changes>
Changes:
[yathu] [BEAM-14375] Fix Java Wordcount Dataflow postcommit
[Robert Bradshaw] Allow arithmetic between deferred scalars.
[noreply] [BEAM-14390] Set user-agent when pulling licenses to avoid 403s (#17521)
[noreply] [BEAM-8688] Upgrade GCSIO to 2.2.6 (#17486)
[noreply] [BEAM-14253] patch SubscriptionPartitionLoader to work around a dataflow
[noreply] Add website link log to notify user of pre-build workflow. (#17498)
[noreply] [BEAM-11105] Add timestamp observing watermark estimation (#17476)
[noreply] Merge pull request #17487 from Adding user-agent to GCS client in Python
[noreply] [BEAM-10265] Display error message if trying to infer recursive schema
[noreply] [BEAM-12575] Upgraded ipykernel from v5 to v6 (#17526)
[noreply] [BEAM-11105] Add docs + CHANGES.md entry for Go Watermark Estimation
[noreply] Merge pull request #17380 from [BEAM-14314][BEAM-9532] Add last_updated
------------------------------------------
[...truncated 17.36 KB...]
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c5"
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651576480197248312/****\022@9469aad017f592f98ec13d096c1a887a2a2c819cc6c728ec9a526347e22798b3"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/03 11:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651576480197248312/model
2022/05/03 11:14:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651576480197248312/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651576480197248312/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/03 11:14:41 Submitted job: 2022-05-03_04_14_40-17107207761468874636
2022/05/03 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-03_04_14_40-17107207761468874636?project=apache-beam-testing
2022/05/03 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-03_04_14_40-17107207761468874636
2022/05/03 11:14:41 Job state: JOB_STATE_PENDING ...
2022/05/03 11:15:11 Job still running ...
2022/05/03 11:15:42 Job still running ...
2022/05/03 11:16:12 Job still running ...
2022/05/03 11:16:42 Job still running ...
2022/05/03 11:17:12 Job still running ...
2022/05/03 11:17:42 Failed to execute job: job 2022-05-03_04_14_40-17107207761468874636 failed
panic: Failed to execute job: job 2022-05-03_04_14_40-17107207761468874636 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x122e1e8, 0xc0000480c0, 0x110b4e7, 0x19, 0xc0005fde68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/mgsseehpks2tk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #496
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/496/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11105] Add manual watermark estimation (#17475)
------------------------------------------
[...truncated 17.38 KB...]
component_coder_ids: "c5"
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651490080383081791/****\022@530c8060dd70daedac2ab5b8c66f220f07189c67be45725ffb046aaf2ee21133"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/02 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651490080383081791/model
2022/05/02 11:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651490080383081791/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651490080383081791/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/02 11:14:41 Submitted job: 2022-05-02_04_14_41-7991502072018766536
2022/05/02 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-02_04_14_41-7991502072018766536?project=apache-beam-testing
2022/05/02 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-02_04_14_41-7991502072018766536
2022/05/02 11:14:41 Job state: JOB_STATE_PENDING ...
2022/05/02 11:15:11 Job still running ...
2022/05/02 11:15:41 Job still running ...
2022/05/02 11:16:12 Job still running ...
2022/05/02 11:16:42 Job still running ...
2022/05/02 11:17:12 Job still running ...
2022/05/02 11:17:42 Job still running ...
2022/05/02 11:18:12 Job still running ...
2022/05/02 11:18:42 Job still running ...
2022/05/02 11:19:12 Job still running ...
2022/05/02 11:19:42 Failed to execute job: job 2022-05-02_04_14_41-7991502072018766536 failed
panic: Failed to execute job: job 2022-05-02_04_14_41-7991502072018766536 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120aa48, 0xc000120000, 0x10e8184, 0x19, 0xc00041fe68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/63edeh25jqbje
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #495
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/495/display/redirect?page=changes>
Changes:
[noreply] Revert "Improvement to Seed job configuration to launch against PRs
[ilion.beyst] Minor: fix typo
[noreply] Merge pull request #17422 from [BEAM-14344]: remove tracing from
------------------------------------------
[...truncated 17.45 KB...]
component_coder_ids: "c5"
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651403676958150470/****\022@c7ae89a0f6002bb078c0953452e2bc5d7e6531247bddaba76672134a19f57b1d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/01 11:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651403676958150470/model
2022/05/01 11:14:37 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651403676958150470/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651403676958150470/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/05/01 11:14:38 Submitted job: 2022-05-01_04_14_37-1203156572924052887
2022/05/01 11:14:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-01_04_14_37-1203156572924052887?project=apache-beam-testing
2022/05/01 11:14:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-01_04_14_37-1203156572924052887
2022/05/01 11:14:38 Job state: JOB_STATE_PENDING ...
2022/05/01 11:15:08 Job still running ...
2022/05/01 11:15:38 Job still running ...
2022/05/01 11:16:08 Job still running ...
2022/05/01 11:16:38 Job still running ...
2022/05/01 11:17:08 Job still running ...
2022/05/01 11:17:38 Job still running ...
2022/05/01 11:18:08 Job still running ...
2022/05/01 11:18:38 Job still running ...
2022/05/01 11:19:08 Job still running ...
2022/05/01 11:19:38 Failed to execute job: job 2022-05-01_04_14_37-1203156572924052887 failed
panic: Failed to execute job: job 2022-05-01_04_14_37-1203156572924052887 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209748, 0xc0000480c0, 0x10e70b2, 0x19, 0xc000855e68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wk2lldlqwpk46
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #494
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/494/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Add element weighting parameter to BatchElements.
[Robert Bradshaw] Clearer test.
[noreply] Revert "Merge pull request #17260 from [BEAM-13229] [Website] bug side
[noreply] [BEAM-14001] Add missing test cases to existing suites in exec package
[noreply] [BEAM-14243] Add staticcheck to Github Actions Precommits (#17479)
[noreply] [BEAM-14368][BEAM-13984]Change model loading from constructor to
[noreply] [BEAM-13983] changed file name from sklearn_loader to sklearn_inference
[noreply] Add SQL in Notebooks blog post (#17481)
[noreply] Merge pull request #17404: [BEAM-13990] support date and timestamp
------------------------------------------
[...truncated 17.32 KB...]
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c5"
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651317278123143372/****\022@c7ae89a0f6002bb078c0953452e2bc5d7e6531247bddaba76672134a19f57b1d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/30 11:14:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651317278123143372/model
2022/04/30 11:14:38 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651317278123143372/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651317278123143372/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/30 11:14:39 Submitted job: 2022-04-30_04_14_38-15271518655655570463
2022/04/30 11:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-30_04_14_38-15271518655655570463?project=apache-beam-testing
2022/04/30 11:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-30_04_14_38-15271518655655570463
2022/04/30 11:14:39 Job state: JOB_STATE_PENDING ...
2022/04/30 11:15:09 Job still running ...
2022/04/30 11:15:39 Job still running ...
2022/04/30 11:16:10 Job still running ...
2022/04/30 11:16:40 Job still running ...
2022/04/30 11:17:10 Job still running ...
2022/04/30 11:17:40 Failed to execute job: job 2022-04-30_04_14_38-15271518655655570463 failed
panic: Failed to execute job: job 2022-04-30_04_14_38-15271518655655570463 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209748, 0xc0000480c0, 0x10e70b2, 0x19, 0xc0008b5e68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 16s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/i5bqjvkstn4tk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #493
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/493/display/redirect?page=changes>
Changes:
[ihr] Update Java katas to Beam 2.38
[noreply] [BEAM-14369] Fix "target/options: no such file or directory" error while
[noreply] [BEAM-14297] Enable nullable key and value arrays for xlang kafka io
[noreply] Merge pull request #17444 from [BEAM-14310] [Website] bug home
[noreply] Merge pull request #17388 from [BEAM-14311] [Website] Home Page
[noreply] [BEAM-14376] Typo in method description doc
[noreply] Add default classpath when not present (#17491)
[thiagotnunes] fix: update javadocs for ChangeStreamMetrics
[noreply] Merge pull request #17443 from [BEAM-12164]: use the end timestamp for
[noreply] Merge pull request #17260 from [BEAM-13229] [Website] bug side nav
[noreply] [BEAM-14351] Fix the template and move the announcement to the next
------------------------------------------
[...truncated 17.37 KB...]
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c5"
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651230880732906721/****\022@c7ae89a0f6002bb078c0953452e2bc5d7e6531247bddaba76672134a19f57b1d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/29 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651230880732906721/model
2022/04/29 11:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651230880732906721/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651230880732906721/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/29 11:14:41 Submitted job: 2022-04-29_04_14_41-3702943351343415152
2022/04/29 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-29_04_14_41-3702943351343415152?project=apache-beam-testing
2022/04/29 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-29_04_14_41-3702943351343415152
2022/04/29 11:14:41 Job state: JOB_STATE_PENDING ...
2022/04/29 11:15:11 Job still running ...
2022/04/29 11:15:41 Job still running ...
2022/04/29 11:16:12 Job still running ...
2022/04/29 11:16:42 Job still running ...
2022/04/29 11:17:12 Job still running ...
2022/04/29 11:17:42 Failed to execute job: job 2022-04-29_04_14_41-3702943351343415152 failed
panic: Failed to execute job: job 2022-04-29_04_14_41-3702943351343415152 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209748, 0xc000120000, 0x10e70b2, 0x19, 0xc0004f9e68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/gak2wnfljfaqg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #492
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/492/display/redirect?page=changes>
Changes:
[nick.caballero] [BEAM-14363] Fixes WatermarkParameters builder for Kinesis
[noreply] [BEAM-11104] Add Checkpointing split to Go SDK (#17386)
[noreply] Merge pull request #17226 from [BEAM-14204] [Playground] Tests for
[noreply] [BEAM-13015, BEAM-14184] Address unbounded number of messages being
[noreply] Improvement to Seed job configuration to launch against PRs (#17468)
[noreply] [BEAM-13983] Small changes to sklearn runinference (#17459)
[chamikaramj] Renames ExternalPythonTransform to PythonExternalTransform
[noreply] [BEAM-14351] Inherit from Coder. (#17437)
------------------------------------------
[...truncated 17.24 KB...]
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c5"
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651144473683239804/****\022@c7ae89a0f6002bb078c0953452e2bc5d7e6531247bddaba76672134a19f57b1d"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/28 11:14:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651144473683239804/model
2022/04/28 11:14:34 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651144473683239804/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651144473683239804/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/28 11:14:34 Submitted job: 2022-04-28_04_14_34-995233978919696732
2022/04/28 11:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-28_04_14_34-995233978919696732?project=apache-beam-testing
2022/04/28 11:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-28_04_14_34-995233978919696732
2022/04/28 11:14:35 Job state: JOB_STATE_PENDING ...
2022/04/28 11:15:05 Job still running ...
2022/04/28 11:15:35 Job still running ...
2022/04/28 11:16:05 Job still running ...
2022/04/28 11:16:35 Job still running ...
2022/04/28 11:17:05 Job still running ...
2022/04/28 11:17:35 Failed to execute job: job 2022-04-28_04_14_34-995233978919696732 failed
panic: Failed to execute job: job 2022-04-28_04_14_34-995233978919696732 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209748, 0xc000120000, 0x10e70b2, 0x19, 0xc00040de68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 11s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/frox5fjqcjcp2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #491
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/491/display/redirect?page=changes>
Changes:
[msbukal] FhirIO: use .search() or .searchType instead of .setResourceType()
[noreply] Remove unnecessary decorator from RunInference interface (#17463)
[noreply] [BEAM-13590] Minor deprecated warning fix (#17453)
[noreply] [BEAM-12164]: fix the negative throughput issue (#17461)
[noreply] Updated goldens for the screen diff integration tests (#17467)
[noreply] fixes copy by value error for bytes.Buffer in Error (#17469)
[noreply] Merge pull request #17354 from [BEAM-14170] - Create a test that runs
[noreply] Merge pull request #17447 from [BEAM-14357] Fix
[noreply] [BEAM-14324, BEAM-14325] Staticcheck cleanup in test files (#17393)
[noreply] BEAM-14187 Fix NPE (#17454)
[noreply] [BEAM-11105] Stateful watermark estimation (#17374)
[noreply] [BEAM-14304] implement parquetio to read/write parquet files (#17347)
------------------------------------------
[...truncated 17.26 KB...]
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c5"
component_coder_ids: "c6"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651058073364325344/****\022@d267add035eb52bfd1973070a9580ba3cdef5344c135e22040a83fcbf1168014"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/27 11:14:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651058073364325344/model
2022/04/27 11:14:34 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0427100419"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651058073364325344/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651058073364325344/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0427100419",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/27 11:14:34 Submitted job: 2022-04-27_04_14_34-17081245784420134682
2022/04/27 11:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-27_04_14_34-17081245784420134682?project=apache-beam-testing
2022/04/27 11:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-27_04_14_34-17081245784420134682
2022/04/27 11:14:34 Job state: JOB_STATE_PENDING ...
2022/04/27 11:15:04 Job still running ...
2022/04/27 11:15:34 Job still running ...
2022/04/27 11:16:04 Job still running ...
2022/04/27 11:16:34 Job still running ...
2022/04/27 11:17:04 Job still running ...
2022/04/27 11:17:35 Failed to execute job: job 2022-04-27_04_14_34-17081245784420134682 failed
panic: Failed to execute job: job 2022-04-27_04_14_34-17081245784420134682 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208328, 0xc0000480c0, 0x10e5f92, 0x19, 0xc000549e68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 10s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/aj5rhbbexe5a6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #490
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/490/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-14343] Allow expansion service override in ExternalPythonTransform
[Heejong Lee] update
[Heejong Lee] allows remote host
[Heejong Lee] improve compatibility with python rowcoder
[ahmedabualsaud] added tempLocation to test pipeline options
[ahmedabualsaud] using tempRoot for temp bucket location
[ahmedabualsaud] small fixes
[noreply] [BEAM-14320] Update programming-guide w/Java GroupByKey example (#17369)
[noreply] Minor: Fix release script for `current` symlinks (#17457)
[noreply] Minor: fix typo (#17452)
[noreply] Change return type for PytorchInferenceRunner (#17460)
[noreply] [BEAM-13608] JmsIO dynamic topics feature (#17163)
[Heejong Lee] add test
------------------------------------------
[...truncated 16.98 KB...]
key: "c5"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c4"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650971665459731516/****\022@2fe3fcd517b9019d3d4bfd67e9102bd0ecbae3f942f5518a641bd1472d159aa7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/26 11:14:26 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650971665459731516/model
2022/04/26 11:14:26 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0426100415"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650971665459731516/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650971665459731516/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0426100415",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/26 11:14:27 Submitted job: 2022-04-26_04_14_26-16032744212517726053
2022/04/26 11:14:27 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-26_04_14_26-16032744212517726053?project=apache-beam-testing
2022/04/26 11:14:27 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-26_04_14_26-16032744212517726053
2022/04/26 11:14:27 Job state: JOB_STATE_PENDING ...
2022/04/26 11:14:57 Job still running ...
2022/04/26 11:15:27 Job still running ...
2022/04/26 11:15:57 Job still running ...
2022/04/26 11:16:27 Job still running ...
2022/04/26 11:16:57 Job still running ...
2022/04/26 11:17:28 Failed to execute job: job 2022-04-26_04_14_26-16032744212517726053 failed
panic: Failed to execute job: job 2022-04-26_04_14_26-16032744212517726053 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030e8, 0xc000120000, 0x10e1a7b, 0x19, 0xc0005e1e68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 7s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/apct74pduckxq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #489
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/489/display/redirect>
Changes:
------------------------------------------
[...truncated 17.06 KB...]
key: "c5"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c4"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650885280713259917/****\022@2fe3fcd517b9019d3d4bfd67e9102bd0ecbae3f942f5518a641bd1472d159aa7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/25 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650885280713259917/model
2022/04/25 11:14:41 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0425100358"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650885280713259917/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650885280713259917/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0425100358",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/25 11:14:42 Submitted job: 2022-04-25_04_14_41-3135459039358807346
2022/04/25 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-25_04_14_41-3135459039358807346?project=apache-beam-testing
2022/04/25 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-25_04_14_41-3135459039358807346
2022/04/25 11:14:42 Job state: JOB_STATE_PENDING ...
2022/04/25 11:15:12 Job still running ...
2022/04/25 11:15:42 Job still running ...
2022/04/25 11:16:12 Job still running ...
2022/04/25 11:16:42 Job still running ...
2022/04/25 11:17:12 Job still running ...
2022/04/25 11:17:42 Failed to execute job: job 2022-04-25_04_14_41-3135459039358807346 failed
panic: Failed to execute job: job 2022-04-25_04_14_41-3135459039358807346 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030e8, 0xc000120000, 0x10e1a7b, 0x19, 0xc00076fe68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/lkvweevsm6uwy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #488
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/488/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13953] added documentation for BQ Storage Write API (#17391)
------------------------------------------
[...truncated 17.11 KB...]
>
component_coder_ids: "c4"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650798879929467693/****\022@2fe3fcd517b9019d3d4bfd67e9102bd0ecbae3f942f5518a641bd1472d159aa7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/24 11:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650798879929467693/model
2022/04/24 11:14:40 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0424100359"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650798879929467693/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650798879929467693/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0424100359",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/24 11:14:41 Submitted job: 2022-04-24_04_14_40-2901583024172633209
2022/04/24 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-24_04_14_40-2901583024172633209?project=apache-beam-testing
2022/04/24 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-24_04_14_40-2901583024172633209
2022/04/24 11:14:41 Job state: JOB_STATE_PENDING ...
2022/04/24 11:15:11 Job still running ...
2022/04/24 11:15:41 Job still running ...
2022/04/24 11:16:11 Job still running ...
2022/04/24 11:16:41 Job still running ...
2022/04/24 11:17:11 Job still running ...
2022/04/24 11:17:41 Job still running ...
2022/04/24 11:18:11 Job still running ...
2022/04/24 11:18:41 Job still running ...
2022/04/24 11:19:11 Job still running ...
2022/04/24 11:19:42 Failed to execute job: job 2022-04-24_04_14_40-2901583024172633209 failed
panic: Failed to execute job: job 2022-04-24_04_14_40-2901583024172633209 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030e8, 0xc000120000, 0x10e1a7b, 0x19, 0xc00041fe68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/slh4aek4nhwbk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #487
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/487/display/redirect?page=changes>
Changes:
[Andrew Pilloud] [BEAM-14321] SQL passes Null for Null aggregates
[noreply] Create apache-hop-with-dataflow.md
[noreply] Add files via upload
[noreply] Delete website/www/site/content/en/blog/apache-hop-with-dataflow
[noreply] Add files via upload
[Andrew Pilloud] [BEAM-14348] Upgrade to ZetaSQL 2022.04.1
[Andrew Pilloud] [BEAM-13735] Enable ZetaSQL tests for Java 17
[noreply] Update apache-hop-with-dataflow.md
[noreply] Update apache-hop-with-dataflow.md
[noreply] Update apache-hop-with-dataflow.md
[danielamartinmtz] Moved up get-credentials instruction for getting the kubeconfig file
[noreply] [BEAM-13657] Add python 3.6 update to CHANGES.md (#17435)
[noreply] Merge pull request #17438: [BEAM-8127] The GCP module to declare
[noreply] Merge pull request #17428: [BEAM-14326] Make sure BigQuery daemon thread
[noreply] [BEAM-14301] Add lint:ignore to noescape() func (#17355)
[noreply] [BEAM-14286] Remove unused vars in harness package (#17392)
[noreply] [BEAM-14327] Convert Results to QueryResults directly (#17398)
[noreply] [BEAM-14302] Simplify boolean check in fn.go (#17399)
[noreply] [BEAM-13983] Sklearn Loader for RunInference (#17368)
[noreply] Update authors.yml
[noreply] [BEAM-14358] add retry to connect to testcontainer (#17449)
[noreply] [BEAM-13106] Bump flink docs to 1.14 (#17430)
------------------------------------------
[...truncated 17.09 KB...]
>
component_coder_ids: "c4"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650712478629777475/****\022@2fe3fcd517b9019d3d4bfd67e9102bd0ecbae3f942f5518a641bd1472d159aa7"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/23 11:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650712478629777475/model
2022/04/23 11:14:39 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0423100413"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650712478629777475/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650712478629777475/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0423100413",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/23 11:14:40 Submitted job: 2022-04-23_04_14_39-4076309692626444915
2022/04/23 11:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-23_04_14_39-4076309692626444915?project=apache-beam-testing
2022/04/23 11:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-23_04_14_39-4076309692626444915
2022/04/23 11:14:40 Job state: JOB_STATE_PENDING ...
2022/04/23 11:15:10 Job still running ...
2022/04/23 11:15:40 Job still running ...
2022/04/23 11:16:10 Job still running ...
2022/04/23 11:16:40 Job still running ...
2022/04/23 11:17:10 Job still running ...
2022/04/23 11:17:40 Job still running ...
2022/04/23 11:18:10 Job still running ...
2022/04/23 11:18:41 Job still running ...
2022/04/23 11:19:11 Job still running ...
2022/04/23 11:19:41 Failed to execute job: job 2022-04-23_04_14_39-4076309692626444915 failed
panic: Failed to execute job: job 2022-04-23_04_14_39-4076309692626444915 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030e8, 0xc0000480c0, 0x10e1a7b, 0x19, 0xc000759e68, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/j3wlzdu2vq5ja
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #486
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/486/display/redirect?page=changes>
Changes:
[mmack] [BEAM-14335] Spotless Spark sources
[mmack] [BEAM-14345] Force paranamer 2.8 for Spark Hadoop version tests to avoid
[noreply] BEAM-13582 Fixing broken links in the documentation (#17300)
[kamil.bregula] Revert "[BEAM-14300] Fix Java precommit failure"
[kamil.bregula] Revert "Merge pull request #17223 from [BEAM-14215] Improve argument
[noreply] [BEAM-13657] Sunset python 3.6 (#17252)
[noreply] Removes unsupported Python 3.6 from the release validation script
[noreply] [BEAM-13984] Implement RunInference for PyTorch (#17196)
[noreply] [BEAM-13945] add json type support for java bigquery connector (#17209)
[noreply] [BEAM-14346] Fix incorrect error case index in ret2() (#17425)
[noreply] [BEAM-14342] Fix wrong default buffer type in fn_runner (#17420)
[noreply] Updates opencensus-api dependency to the latest version - 0.31.0
[noreply] [BEAM-14306] Add unit testing to pane coder (#17370)
[noreply] Updated the dep and golden for screen diff integration tests (#17442)
------------------------------------------
[...truncated 17.06 KB...]
key: "c5"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c4"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650626083765026754/****\022@481771bde4db2f4b1d409c2eb3ce2d9d6848529da24e3af1efc7390617339824"
role_urn: "beam:artifact:role:go_****_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/22 11:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650626083765026754/model
2022/04/22 11:14:44 {
"environment": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "load-tests-go-dataflow-batch-sideinput-3-0422100420"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_****,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value": "apache/beam_go_sdk:2.39.0.dev"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value": "gs://temp-storage-for-perf-tests/loadtests"
},
{
"key": "influx_measurement",
"namespace": "go_options",
"type": "STRING",
"value": "go_batch_sideinput_3"
},
{
"key": "influx_hostname",
"namespace": "go_options",
"type": "STRING",
"value": "http://10.128.0.96:8086"
},
{
"key": "****_binary",
"namespace": "go_options",
"type": "STRING",
"value": "linux_amd64/sideinput"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "access_percentage",
"namespace": "go_options",
"type": "STRING",
"value": "1"
},
{
"key": "influx_namespace",
"namespace": "go_options",
"type": "STRING",
"value": "dataflow"
},
{
"key": "influx_db_name",
"namespace": "go_options",
"type": "STRING",
"value": "beam_test_metrics"
},
{
"key": "input_options",
"namespace": "go_options",
"type": "STRING",
"value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
}
],
"options": {
"experiments": [
"use_unified_****",
"use_portable_job_submission",
"beam_fn_api"
],
"pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650626083765026754/model",
"region": "us-central1",
"tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
},
"beam:option:go_options:v1": {
"options": {
"access_percentage": "1",
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"influx_db_name": "beam_test_metrics",
"influx_hostname": "http://10.128.0.96:8086",
"influx_measurement": "go_batch_sideinput_3",
"influx_namespace": "dataflow",
"input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
"****_binary": "linux_amd64/sideinput"
}
}
},
"tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.39.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"****Pools": [
{
"autoscalingSettings": {
"algorithm": "AUTOSCALING_ALGORITHM_NONE"
},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 10,
"packages": [
{
"location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650626083765026754/****",
"name": "****"
}
],
"sdkHarnessContainerImages": [
{
"containerImage": "apache/beam_go_sdk:2.39.0.dev"
}
],
"****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
}
]
},
"name": "load-tests-go-dataflow-batch-sideinput-3-0422100420",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/04/22 11:14:45 Submitted job: 2022-04-22_04_14_44-3328384947147369364
2022/04/22 11:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-22_04_14_44-3328384947147369364?project=apache-beam-testing
2022/04/22 11:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-22_04_14_44-3328384947147369364
2022/04/22 11:14:45 Job state: JOB_STATE_PENDING ...
2022/04/22 11:15:15 Job still running ...
2022/04/22 11:15:45 Job still running ...
2022/04/22 11:16:15 Job still running ...
2022/04/22 11:16:45 Job still running ...
2022/04/22 11:17:15 Job still running ...
2022/04/22 11:17:45 Failed to execute job: job 2022-04-22_04_14_44-3328384947147369364 failed
panic: Failed to execute job: job 2022-04-22_04_14_44-3328384947147369364 failed
goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203108, 0xc000120000, 0x10e1a7b, 0x19, 0xc0007c7df0, 0x1, 0x1)
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474
> Task :sdks:go:test:load:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31
* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/shdsrvx4zd2pc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org