You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/03/10 09:03:28 UTC

Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #444

See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/444/display/redirect?page=changes>

Changes:

[hengfeng] [BEAM-12164]: display the metadata table's name on UI

[noreply] Revert "[BEAM-13993] [BEAM-10039] Import beam plugins before starting

[noreply] Merge pull request #17036 from [BEAM-12164] Convert all static instances

[noreply] fix variable reference (#16991)

[noreply] Merge pull request #16844 from [BEAM-12164]: allow for nanosecond

[noreply] [BEAM-13904] Increase unit testing in the reflectx package (#17024)


------------------------------------------
[...truncated 25.05 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646902787614508896/****\022@5bd6da88c3a49da38bf70d7845362e43f05d24edfcb361bac6e696e3bc9633ee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/10 08:59:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646902787614508896/model
2022/03/10 08:59:48 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0308201451"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646902787614508896/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646902787614508896/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0308201451",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/10 08:59:48 Submitted job: 2022-03-10_00_59_48-14168047639653035343
2022/03/10 08:59:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-10_00_59_48-14168047639653035343?project=apache-beam-testing
2022/03/10 08:59:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-10_00_59_48-14168047639653035343
2022/03/10 08:59:49 Job state: JOB_STATE_PENDING ...
2022/03/10 09:00:19 Job still running ...
2022/03/10 09:00:49 Job still running ...
2022/03/10 09:01:19 Job still running ...
2022/03/10 09:01:49 Job still running ...
2022/03/10 09:02:19 Job still running ...
2022/03/10 09:02:49 Job still running ...
2022/03/10 09:03:19 Failed to execute job: job 2022-03-10_00_59_48-14168047639653035343 failed
panic: Failed to execute job: job 2022-03-10_00_59_48-14168047639653035343 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11516c8, 0xc0000480c0, 0x103e995, 0x19, 0xc000535df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/e5mwpqindeqdc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_LoadTests_Go_CoGBK_Dataflow_batch #502

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/502/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #501

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/501/display/redirect?page=changes>

Changes:

[zyichi] Move master readme.md to 2.40.0

[noreply] [BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink


------------------------------------------
[...truncated 25.54 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651770483920939626/****\022@8b4fc97c79be3e1b632e6395d5832375e5a0d77438b346d72de8de175e2ead2b"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 17:08:05 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651770483920939626/model
2022/05/05 17:08:05 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0505150518"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.40.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770483920939626/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.40.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770483920939626/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.40.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0505150518",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/05 17:08:05 Submitted job: 2022-05-05_10_08_05-219944056484027230
2022/05/05 17:08:05 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_10_08_05-219944056484027230?project=apache-beam-testing
2022/05/05 17:08:05 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_10_08_05-219944056484027230
2022/05/05 17:08:05 Job state: JOB_STATE_PENDING ...
2022/05/05 17:08:35 Job still running ...
2022/05/05 17:09:05 Job still running ...
2022/05/05 17:09:36 Job still running ...
2022/05/05 17:10:06 Job still running ...
2022/05/05 17:10:36 Job still running ...
2022/05/05 17:11:06 Job still running ...
2022/05/05 17:11:36 Job still running ...
2022/05/05 17:12:06 Job still running ...
2022/05/05 17:12:36 Job still running ...
2022/05/05 17:13:06 Failed to execute job: job 2022-05-05_10_08_05-219944056484027230 failed
panic: Failed to execute job: job 2022-05-05_10_08_05-219944056484027230 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231cc8, 0xc0000480c0, 0x110e910, 0x19, 0xc0007dbe68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 7m 13s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5bdmxtskf5mvm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #500

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/500/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-9245] Unable to pull datatore Entity which contains dict

[bulat.safiullin] [BEAM-14382] [Website] add banner container for with css, images, html

[Jan Lukavský] [BEAM-14196] add test verifying output watermark propagation in bundle

[Jan Lukavský] [BEAM-14196] Fix FlinkRunner mid-bundle output watermark handling

[nielm] [BEAM-14405] Fix NPE when ProjectID is not specified in a template

[bulat.safiullin] [BEAM-14382] change mobile banner img, add padding to banner section

[ahmedabualsaud] fix test decotrator typo

[noreply] Merge pull request #17440 from [BEAM-14329] Enable exponential backoff

[noreply] [BEAM-11104] Fix output forwarding issue for ProcessContinuations

[noreply] re-add testing package to pydoc (#17524)

[Heejong Lee] add test

[noreply] [BEAM-14250] Amended the workaround (#17531)

[noreply] [BEAM-11104] Fix broken split result validation (#17546)

[noreply] Fixed a SQL and screenshots in the Beam SQL blog (#17545)

[noreply] Merge pull request #17417: [BEAM-14388] Address some performance

[noreply] [BEAM-14386] [Flink] Support for scala 2.12 (#17512)

[noreply] [BEAM-14294] Worker changes to support trivial Batched DoFns (#17384)

[zyichi] Moving to 2.40.0-SNAPSHOT on master branch.

[noreply] [BEAM-14048] [CdapIO] Add ConfigWrapper for building CDAP PluginConfigs


------------------------------------------
[...truncated 25.37 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651741190190624315/****\022@12f43621d6fa22fb224a2e9ed726972f071a9d5d5f7d1076335e3c38f2aef599"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651741190190624315/model
2022/05/05 08:59:50 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0505065639"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.40.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651741190190624315/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.40.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651741190190624315/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.40.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0505065639",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/05 08:59:51 Submitted job: 2022-05-05_01_59_50-6104742215596577622
2022/05/05 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_01_59_50-6104742215596577622?project=apache-beam-testing
2022/05/05 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_01_59_50-6104742215596577622
2022/05/05 08:59:51 Job state: JOB_STATE_PENDING ...
2022/05/05 09:00:21 Job still running ...
2022/05/05 09:00:51 Job still running ...
2022/05/05 09:01:21 Job still running ...
2022/05/05 09:01:51 Job still running ...
2022/05/05 09:02:21 Job still running ...
2022/05/05 09:02:51 Job still running ...
2022/05/05 09:03:21 Job still running ...
2022/05/05 09:03:51 Job still running ...
2022/05/05 09:04:22 Job still running ...
2022/05/05 09:04:52 Failed to execute job: job 2022-05-05_01_59_50-6104742215596577622 failed
panic: Failed to execute job: job 2022-05-05_01_59_50-6104742215596577622 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231c68, 0xc0000480c0, 0x110e8b0, 0x19, 0xc000427e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 24s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/af5lorkpttzfg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #499

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/499/display/redirect?page=changes>

Changes:

[noreply] fix: JDBC config schema fields order

[Brian Hulette] Revert "Merge pull request #17255 from kileys/test-revert"

[Brian Hulette] BEAM-14231: bypass schema cache for

[noreply] [BEAM-13657] Follow up update version warning in __init__ (#17493)

[noreply] Merge pull request #17431 from [BEAM-14273] Add integration tests for BQ

[noreply] Merge pull request #17205 from [BEAM-14145] [Website] add carousel to

[noreply] [BEAM-14064] fix es io windowing (#17112)

[noreply] [BEAM-13670] Upgraded ipython from v7 to v8 (#17529)

[noreply] [BEAM-11104] Enable ProcessContinuation return values, add unit test

[Robert Bradshaw] [BEAM-14403] Allow Prime to be used with legacy workers.

[noreply] [BEAM-11106] Support drain in Go SDK (#17432)

[noreply] add __Init__ to inference. (#17514)


------------------------------------------
[...truncated 25.36 KB...]
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651654982677033301/****\022@be83bf2a90738eb6e70a1e09f135cf25fbfc968e0a33e2e4cefcd37425687cf7"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/04 09:03:03 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651654982677033301/model
2022/05/04 09:03:03 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0428111113"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651654982677033301/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651654982677033301/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0428111113",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/04 09:03:04 Submitted job: 2022-05-04_02_03_03-16177773235875381780
2022/05/04 09:03:04 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-04_02_03_03-16177773235875381780?project=apache-beam-testing
2022/05/04 09:03:04 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-04_02_03_03-16177773235875381780
2022/05/04 09:03:04 Job state: JOB_STATE_PENDING ...
2022/05/04 09:03:34 Job still running ...
2022/05/04 09:04:04 Job still running ...
2022/05/04 09:04:34 Job still running ...
2022/05/04 09:05:04 Job still running ...
2022/05/04 09:05:34 Job still running ...
2022/05/04 09:06:04 Job still running ...
2022/05/04 09:06:34 Job still running ...
2022/05/04 09:07:04 Job still running ...
2022/05/04 09:07:34 Job still running ...
2022/05/04 09:08:04 Job still running ...
2022/05/04 09:08:35 Failed to execute job: job 2022-05-04_02_03_03-16177773235875381780 failed
panic: Failed to execute job: job 2022-05-04_02_03_03-16177773235875381780 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231c68, 0xc00019a000, 0x110e8b0, 0x19, 0xc000353e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 7m 27s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dgwhajnlnm7as

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #498

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/498/display/redirect?page=changes>

Changes:

[yathu] [BEAM-14375] Fix Java Wordcount Dataflow postcommit

[Robert Bradshaw] Allow arithmetic between deferred scalars.

[noreply] [BEAM-14390] Set user-agent when pulling licenses to avoid 403s (#17521)

[noreply] [BEAM-8688] Upgrade GCSIO to 2.2.6 (#17486)

[noreply] [BEAM-14253] patch SubscriptionPartitionLoader to work around a dataflow

[noreply] Add website link log to notify user of pre-build workflow. (#17498)

[noreply] [BEAM-11105] Add timestamp observing watermark estimation (#17476)

[noreply] Merge pull request #17487 from Adding user-agent to GCS client in Python

[noreply] [BEAM-10265] Display error message if trying to infer recursive schema

[noreply] [BEAM-12575] Upgraded ipykernel from v5 to v6 (#17526)

[noreply] [BEAM-11105] Add docs + CHANGES.md entry for Go Watermark Estimation

[noreply] Merge pull request #17380 from [BEAM-14314][BEAM-9532] Add last_updated


------------------------------------------
[...truncated 25.30 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651568397593071762/****\022@f4796777cccf2da4f8622139c4c681b54a8aa369cc580b1a0dbd6f8a4c75e278"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/03 08:59:58 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651568397593071762/model
2022/05/03 08:59:58 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0428111113"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651568397593071762/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651568397593071762/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0428111113",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/03 08:59:58 Submitted job: 2022-05-03_01_59_58-15340143660352117157
2022/05/03 08:59:58 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-03_01_59_58-15340143660352117157?project=apache-beam-testing
2022/05/03 08:59:58 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-03_01_59_58-15340143660352117157
2022/05/03 08:59:59 Job state: JOB_STATE_PENDING ...
2022/05/03 09:00:29 Job still running ...
2022/05/03 09:00:59 Job still running ...
2022/05/03 09:01:29 Job still running ...
2022/05/03 09:02:00 Job still running ...
2022/05/03 09:02:30 Job still running ...
2022/05/03 09:03:00 Failed to execute job: job 2022-05-03_01_59_58-15340143660352117157 failed
panic: Failed to execute job: job 2022-05-03_01_59_58-15340143660352117157 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x122e228, 0xc0000480c0, 0x110b39d, 0x19, 0xc00065de68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 25s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ldy7sf3zxxk66

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #497

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/497/display/redirect?page=changes>

Changes:

[noreply] [BEAM-11105] Add manual watermark estimation (#17475)


------------------------------------------
[...truncated 25.33 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651481999805261866/****\022@beab3533de096dd53b55658b5e9a85522316e4a75c4115c681cca4cd787089f5"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/02 09:00:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651481999805261866/model
2022/05/02 09:00:00 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0428111113"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651481999805261866/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651481999805261866/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0428111113",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/02 09:00:02 Submitted job: 2022-05-02_02_00_00-11018270308611985779
2022/05/02 09:00:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-02_02_00_00-11018270308611985779?project=apache-beam-testing
2022/05/02 09:00:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-02_02_00_00-11018270308611985779
2022/05/02 09:00:02 Job state: JOB_STATE_PENDING ...
2022/05/02 09:00:32 Job still running ...
2022/05/02 09:01:02 Job still running ...
2022/05/02 09:01:32 Job still running ...
2022/05/02 09:02:02 Job still running ...
2022/05/02 09:02:32 Job still running ...
2022/05/02 09:03:02 Job still running ...
2022/05/02 09:03:32 Job still running ...
2022/05/02 09:04:02 Job still running ...
2022/05/02 09:04:32 Job still running ...
2022/05/02 09:05:02 Failed to execute job: job 2022-05-02_02_00_00-11018270308611985779 failed
panic: Failed to execute job: job 2022-05-02_02_00_00-11018270308611985779 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120aa88, 0xc000120000, 0x10e803a, 0x19, 0xc0004d7e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 28s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/3k2ayczzpaoq6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #496

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/496/display/redirect?page=changes>

Changes:

[noreply] Revert "Improvement to Seed job configuration to launch against PRs

[ilion.beyst] Minor: fix typo

[noreply] Merge pull request #17422 from [BEAM-14344]: remove tracing from


------------------------------------------
[...truncated 25.40 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651395584037683403/****\022@02167ce37eaf34e7e1107f6999e93b0d14b39169bdb4e9b2712fdcfeb7e25008"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/01 08:59:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651395584037683403/model
2022/05/01 08:59:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0428111113"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651395584037683403/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651395584037683403/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0428111113",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/01 08:59:47 Submitted job: 2022-05-01_01_59_44-16983222494204514587
2022/05/01 08:59:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-01_01_59_44-16983222494204514587?project=apache-beam-testing
2022/05/01 08:59:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-01_01_59_44-16983222494204514587
2022/05/01 08:59:47 Job state: JOB_STATE_PENDING ...
2022/05/01 09:00:17 Job still running ...
2022/05/01 09:00:47 Job still running ...
2022/05/01 09:01:17 Job still running ...
2022/05/01 09:01:47 Job still running ...
2022/05/01 09:02:17 Job still running ...
2022/05/01 09:02:47 Job still running ...
2022/05/01 09:03:17 Job still running ...
2022/05/01 09:03:47 Job still running ...
2022/05/01 09:04:17 Job still running ...
2022/05/01 09:04:47 Failed to execute job: job 2022-05-01_01_59_44-16983222494204514587 failed
panic: Failed to execute job: job 2022-05-01_01_59_44-16983222494204514587 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209788, 0xc000120000, 0x10e6f88, 0x19, 0xc0008e1e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lluq5mh5xn5m4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #495

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/495/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Add element weighting parameter to BatchElements.

[Robert Bradshaw] Clearer test.

[noreply] Revert "Merge pull request #17260 from [BEAM-13229] [Website] bug side

[noreply] [BEAM-14351] Fix the template and move the announcement to the next

[noreply] [BEAM-14001] Add missing test cases to existing suites in exec package

[noreply] [BEAM-14243] Add staticcheck to Github Actions Precommits (#17479)

[noreply] [BEAM-14368][BEAM-13984]Change model loading from constructor to

[noreply] [BEAM-13983] changed file name from sklearn_loader to sklearn_inference

[noreply] Add SQL in Notebooks blog post (#17481)

[noreply] Merge pull request #17404: [BEAM-13990] support date and timestamp


------------------------------------------
[...truncated 25.40 KB...]
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651309191940185099/****\022@02167ce37eaf34e7e1107f6999e93b0d14b39169bdb4e9b2712fdcfeb7e25008"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/30 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651309191940185099/model
2022/04/30 08:59:52 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0428111113"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651309191940185099/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651309191940185099/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0428111113",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/30 08:59:53 Submitted job: 2022-04-30_01_59_52-15330114570241396564
2022/04/30 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-30_01_59_52-15330114570241396564?project=apache-beam-testing
2022/04/30 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-30_01_59_52-15330114570241396564
2022/04/30 08:59:53 Job state: JOB_STATE_PENDING ...
2022/04/30 09:00:23 Job still running ...
2022/04/30 09:00:53 Job still running ...
2022/04/30 09:01:23 Job still running ...
2022/04/30 09:01:53 Job still running ...
2022/04/30 09:02:23 Job still running ...
2022/04/30 09:02:53 Job still running ...
2022/04/30 09:03:23 Job still running ...
2022/04/30 09:03:53 Job still running ...
2022/04/30 09:04:23 Job still running ...
2022/04/30 09:04:53 Job still running ...
2022/04/30 09:05:23 Failed to execute job: job 2022-04-30_01_59_52-15330114570241396564 failed
panic: Failed to execute job: job 2022-04-30_01_59_52-15330114570241396564 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209788, 0xc0000480c0, 0x10e6f88, 0x19, 0xc000873e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/debmcguqicvvk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #494

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/494/display/redirect?page=changes>

Changes:

[ihr] Update Java katas to Beam 2.38

[noreply] [BEAM-14369] Fix "target/options: no such file or directory" error while

[noreply] [BEAM-14351] Inherit from Coder. (#17437)

[noreply] [BEAM-14297] Enable nullable key and value arrays for xlang kafka io

[noreply] Merge pull request #17444 from [BEAM-14310] [Website] bug home

[noreply] Merge pull request #17388 from [BEAM-14311] [Website] Home Page

[noreply] [BEAM-14376] Typo in method description doc

[noreply] Add default classpath when not present (#17491)

[thiagotnunes] fix: update javadocs for ChangeStreamMetrics

[noreply] Merge pull request #17443 from [BEAM-12164]: use the end timestamp for

[noreply] Merge pull request #17260 from [BEAM-13229] [Website] bug side nav


------------------------------------------
[...truncated 25.26 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651222789562320256/****\022@02167ce37eaf34e7e1107f6999e93b0d14b39169bdb4e9b2712fdcfeb7e25008"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/29 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651222789562320256/model
2022/04/29 08:59:50 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0428111113"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651222789562320256/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651222789562320256/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0428111113",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/29 08:59:50 Submitted job: 2022-04-29_01_59_50-12242162761561907738
2022/04/29 08:59:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-29_01_59_50-12242162761561907738?project=apache-beam-testing
2022/04/29 08:59:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-29_01_59_50-12242162761561907738
2022/04/29 08:59:50 Job state: JOB_STATE_PENDING ...
2022/04/29 09:00:20 Job still running ...
2022/04/29 09:00:50 Job still running ...
2022/04/29 09:01:20 Job still running ...
2022/04/29 09:01:51 Job still running ...
2022/04/29 09:02:21 Job still running ...
2022/04/29 09:02:51 Failed to execute job: job 2022-04-29_01_59_50-12242162761561907738 failed
panic: Failed to execute job: job 2022-04-29_01_59_50-12242162761561907738 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209788, 0xc000128000, 0x10e6f88, 0x19, 0xc000403e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5yd6pnbvr36qu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #493

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/493/display/redirect?page=changes>

Changes:

[nick.caballero] [BEAM-14363] Fixes WatermarkParameters builder for Kinesis

[noreply] [BEAM-11104] Add Checkpointing split to Go SDK (#17386)

[noreply] Merge pull request #17226 from [BEAM-14204] [Playground] Tests for

[noreply] [BEAM-13015, BEAM-14184] Address unbounded number of messages being

[noreply] Improvement to Seed job configuration to launch against PRs (#17468)

[noreply] [BEAM-13983] Small changes to sklearn runinference (#17459)

[chamikaramj] Renames ExternalPythonTransform to PythonExternalTransform


------------------------------------------
[...truncated 25.29 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651136392255815660/****\022@02167ce37eaf34e7e1107f6999e93b0d14b39169bdb4e9b2712fdcfeb7e25008"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/28 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651136392255815660/model
2022/04/28 08:59:52 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0428000503"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651136392255815660/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651136392255815660/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0428000503",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/28 08:59:53 Submitted job: 2022-04-28_01_59_52-13933673901126042437
2022/04/28 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-28_01_59_52-13933673901126042437?project=apache-beam-testing
2022/04/28 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-28_01_59_52-13933673901126042437
2022/04/28 08:59:53 Job state: JOB_STATE_PENDING ...
2022/04/28 09:00:23 Job still running ...
2022/04/28 09:00:53 Job still running ...
2022/04/28 09:01:23 Job still running ...
2022/04/28 09:01:53 Job still running ...
2022/04/28 09:02:23 Job still running ...
2022/04/28 09:02:53 Failed to execute job: job 2022-04-28_01_59_52-13933673901126042437 failed
panic: Failed to execute job: job 2022-04-28_01_59_52-13933673901126042437 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209788, 0xc000120000, 0x10e6f88, 0x19, 0xc000841e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 25s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/pkzzxrl6eqwry

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #492

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/492/display/redirect?page=changes>

Changes:

[msbukal] FhirIO: use .search() or .searchType instead of .setResourceType()

[noreply] Remove unnecessary decorator from RunInference interface (#17463)

[noreply] [BEAM-13590] Minor deprecated warning fix (#17453)

[noreply] [BEAM-12164]: fix the negative throughput issue (#17461)

[noreply] Updated goldens for the screen diff integration tests (#17467)

[noreply] fixes copy by value error for bytes.Buffer in Error (#17469)

[noreply] Merge pull request #17354 from [BEAM-14170] - Create a test that runs

[noreply] Merge pull request #17447 from [BEAM-14357] Fix

[noreply] [BEAM-14324, BEAM-14325] Staticcheck cleanup in test files (#17393)

[noreply] BEAM-14187 Fix NPE (#17454)

[noreply] [BEAM-11105] Stateful watermark estimation (#17374)

[noreply] [BEAM-14304] implement parquetio to read/write parquet files (#17347)


------------------------------------------
[...truncated 25.34 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651050000548123764/****\022@831d6712110299ed4c541f12a64173d1d093209638ef5b959c70f393dd9e156f"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/27 09:00:01 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651050000548123764/model
2022/04/27 09:00:01 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0427065641"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651050000548123764/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651050000548123764/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0427065641",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/27 09:00:01 Submitted job: 2022-04-27_02_00_01-10880806066448843646
2022/04/27 09:00:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-27_02_00_01-10880806066448843646?project=apache-beam-testing
2022/04/27 09:00:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-27_02_00_01-10880806066448843646
2022/04/27 09:00:01 Job state: JOB_STATE_PENDING ...
2022/04/27 09:00:32 Job still running ...
2022/04/27 09:01:02 Job still running ...
2022/04/27 09:01:32 Job still running ...
2022/04/27 09:02:02 Job still running ...
2022/04/27 09:02:32 Job still running ...
2022/04/27 09:03:02 Job still running ...
2022/04/27 09:03:32 Job still running ...
2022/04/27 09:04:02 Job still running ...
2022/04/27 09:04:34 Job still running ...
2022/04/27 09:05:05 Failed to execute job: job 2022-04-27_02_00_01-10880806066448843646 failed
panic: Failed to execute job: job 2022-04-27_02_00_01-10880806066448843646 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208368, 0xc000120000, 0x10e5e68, 0x19, 0xc0004d9e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 33s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bypntjijhg52o

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #491

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/491/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14343] Allow expansion service override in ExternalPythonTransform

[Heejong Lee] update

[Heejong Lee] allows remote host

[Heejong Lee] improve compatibility with python rowcoder

[ahmedabualsaud] added tempLocation to test pipeline options

[ahmedabualsaud] using tempRoot for temp bucket location

[ahmedabualsaud] small fixes

[noreply] [BEAM-14320] Update programming-guide w/Java GroupByKey example (#17369)

[noreply] Minor: Fix release script for `current` symlinks (#17457)

[noreply] Minor: fix typo (#17452)

[noreply] Change return type for PytorchInferenceRunner (#17460)

[noreply] [BEAM-13608] JmsIO dynamic topics feature (#17163)

[Heejong Lee] add test


------------------------------------------
[...truncated 24.97 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650963586417460228/****\022@e6209095f34db620fc8140bde17e4628c948ceab23d48878c7458c187955c70e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/26 08:59:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650963586417460228/model
2022/04/26 08:59:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0426065627"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650963586417460228/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650963586417460228/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0426065627",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/26 08:59:47 Submitted job: 2022-04-26_01_59_47-8226974572203910271
2022/04/26 08:59:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-26_01_59_47-8226974572203910271?project=apache-beam-testing
2022/04/26 08:59:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-26_01_59_47-8226974572203910271
2022/04/26 08:59:47 Job state: JOB_STATE_PENDING ...
2022/04/26 09:00:17 Job still running ...
2022/04/26 09:00:48 Job still running ...
2022/04/26 09:01:18 Job still running ...
2022/04/26 09:01:48 Job still running ...
2022/04/26 09:02:18 Job still running ...
2022/04/26 09:02:48 Failed to execute job: job 2022-04-26_01_59_47-8226974572203910271 failed
panic: Failed to execute job: job 2022-04-26_01_59_47-8226974572203910271 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203148, 0xc0000480c0, 0x10e1911, 0x19, 0xc0007fde68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wg6g3enhpqm7a

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #490

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/490/display/redirect>

Changes:


------------------------------------------
[...truncated 24.99 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650877187148511875/****\022@e6209095f34db620fc8140bde17e4628c948ceab23d48878c7458c187955c70e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/25 08:59:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650877187148511875/model
2022/04/25 08:59:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0425065639"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650877187148511875/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650877187148511875/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0425065639",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/25 08:59:48 Submitted job: 2022-04-25_01_59_47-11315734402133377826
2022/04/25 08:59:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-25_01_59_47-11315734402133377826?project=apache-beam-testing
2022/04/25 08:59:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-25_01_59_47-11315734402133377826
2022/04/25 08:59:48 Job state: JOB_STATE_PENDING ...
2022/04/25 09:00:18 Job still running ...
2022/04/25 09:00:48 Job still running ...
2022/04/25 09:01:18 Job still running ...
2022/04/25 09:01:48 Job still running ...
2022/04/25 09:02:18 Job still running ...
2022/04/25 09:02:48 Failed to execute job: job 2022-04-25_01_59_47-11315734402133377826 failed
panic: Failed to execute job: job 2022-04-25_01_59_47-11315734402133377826 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203148, 0xc0000480c0, 0x10e1911, 0x19, 0xc0005dde68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/c53zqo5cf37ak

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #489

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/489/display/redirect?page=changes>

Changes:

[noreply] [BEAM-13953] added documentation for BQ Storage Write API (#17391)


------------------------------------------
[...truncated 24.99 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650790785940167577/****\022@e6209095f34db620fc8140bde17e4628c948ceab23d48878c7458c187955c70e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/24 08:59:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650790785940167577/model
2022/04/24 08:59:46 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0424065639"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650790785940167577/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650790785940167577/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0424065639",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/24 08:59:47 Submitted job: 2022-04-24_01_59_46-18000985266353785506
2022/04/24 08:59:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-24_01_59_46-18000985266353785506?project=apache-beam-testing
2022/04/24 08:59:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-24_01_59_46-18000985266353785506
2022/04/24 08:59:47 Job state: JOB_STATE_PENDING ...
2022/04/24 09:00:17 Job still running ...
2022/04/24 09:00:47 Job still running ...
2022/04/24 09:01:17 Job still running ...
2022/04/24 09:01:47 Job still running ...
2022/04/24 09:02:17 Job still running ...
2022/04/24 09:02:47 Failed to execute job: job 2022-04-24_01_59_46-18000985266353785506 failed
panic: Failed to execute job: job 2022-04-24_01_59_46-18000985266353785506 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203148, 0xc0000480c0, 0x10e1911, 0x19, 0xc00042de68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rifsgv5bqkxxq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #488

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/488/display/redirect?page=changes>

Changes:

[Andrew Pilloud] [BEAM-14321] SQL passes Null for Null aggregates

[noreply] Create apache-hop-with-dataflow.md

[noreply] Add files via upload

[noreply] Delete website/www/site/content/en/blog/apache-hop-with-dataflow

[noreply] Add files via upload

[Andrew Pilloud] [BEAM-14348] Upgrade to ZetaSQL 2022.04.1

[Andrew Pilloud] [BEAM-13735] Enable ZetaSQL tests for Java 17

[noreply] Update apache-hop-with-dataflow.md

[noreply] Update apache-hop-with-dataflow.md

[noreply] Update apache-hop-with-dataflow.md

[danielamartinmtz] Moved up get-credentials instruction for getting the kubeconfig file

[noreply] [BEAM-13657] Add python 3.6 update to CHANGES.md (#17435)

[noreply] Merge pull request #17438: [BEAM-8127] The GCP module to declare

[noreply] Merge pull request #17428: [BEAM-14326] Make sure BigQuery daemon thread

[noreply] [BEAM-14301] Add lint:ignore to noescape() func (#17355)

[noreply] [BEAM-14286] Remove unused vars in harness package (#17392)

[noreply] [BEAM-14327] Convert Results to QueryResults directly (#17398)

[noreply] [BEAM-14302] Simplify boolean check in fn.go (#17399)

[noreply] [BEAM-13983] Sklearn Loader for RunInference (#17368)

[noreply] Update authors.yml

[noreply] [BEAM-14358] add retry to connect to testcontainer (#17449)

[noreply] [BEAM-13106] Bump flink docs to 1.14 (#17430)


------------------------------------------
[...truncated 25.05 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650704394876246636/****\022@e6209095f34db620fc8140bde17e4628c948ceab23d48878c7458c187955c70e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/23 08:59:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650704394876246636/model
2022/04/23 08:59:55 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0423065638"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650704394876246636/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650704394876246636/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0423065638",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/23 08:59:56 Submitted job: 2022-04-23_01_59_55-1259190634671429444
2022/04/23 08:59:56 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-23_01_59_55-1259190634671429444?project=apache-beam-testing
2022/04/23 08:59:56 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-23_01_59_55-1259190634671429444
2022/04/23 08:59:56 Job state: JOB_STATE_PENDING ...
2022/04/23 09:00:26 Job still running ...
2022/04/23 09:00:56 Job still running ...
2022/04/23 09:01:26 Job still running ...
2022/04/23 09:01:56 Job still running ...
2022/04/23 09:02:26 Job still running ...
2022/04/23 09:02:56 Job still running ...
2022/04/23 09:03:27 Job still running ...
2022/04/23 09:03:57 Job still running ...
2022/04/23 09:04:27 Job still running ...
2022/04/23 09:04:57 Failed to execute job: job 2022-04-23_01_59_55-1259190634671429444 failed
panic: Failed to execute job: job 2022-04-23_01_59_55-1259190634671429444 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203148, 0xc000120000, 0x10e1911, 0x19, 0xc000761e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 26s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jsjull36xwkpq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #487

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/487/display/redirect?page=changes>

Changes:

[mmack] [BEAM-14335] Spotless Spark sources

[mmack] [BEAM-14345] Force paranamer 2.8 for Spark Hadoop version tests to avoid

[noreply] BEAM-13582 Fixing broken links in the documentation (#17300)

[kamil.bregula] Revert "[BEAM-14300] Fix Java precommit failure"

[kamil.bregula] Revert "Merge pull request #17223 from [BEAM-14215] Improve argument

[noreply] [BEAM-13657] Sunset python 3.6 (#17252)

[noreply] Removes unsupported Python 3.6 from the release validation script

[noreply] [BEAM-13984] Implement RunInference for PyTorch (#17196)

[noreply] [BEAM-13945] add json type support for java bigquery connector (#17209)

[noreply] [BEAM-14346] Fix incorrect error case index in ret2() (#17425)

[noreply] [BEAM-14342] Fix wrong default buffer type in fn_runner (#17420)

[noreply] Updates opencensus-api dependency to the latest version - 0.31.0

[noreply] [BEAM-14306] Add unit testing to pane coder (#17370)

[noreply] Updated the dep and golden for screen diff integration tests (#17442)


------------------------------------------
[...truncated 25.07 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650617992881443480/****\022@b564cea86b6b11f8da4718bbce66b400483fc61b63100ac92aa67265bb870222"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/22 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650617992881443480/model
2022/04/22 08:59:53 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0422065644"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650617992881443480/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650617992881443480/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0422065644",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/22 08:59:54 Submitted job: 2022-04-22_01_59_53-16836000842276181880
2022/04/22 08:59:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-22_01_59_53-16836000842276181880?project=apache-beam-testing
2022/04/22 08:59:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-22_01_59_53-16836000842276181880
2022/04/22 08:59:54 Job state: JOB_STATE_PENDING ...
2022/04/22 09:00:24 Job still running ...
2022/04/22 09:00:54 Job still running ...
2022/04/22 09:01:24 Job still running ...
2022/04/22 09:01:54 Job still running ...
2022/04/22 09:02:24 Job still running ...
2022/04/22 09:02:54 Job still running ...
2022/04/22 09:03:24 Job still running ...
2022/04/22 09:03:54 Job still running ...
2022/04/22 09:04:24 Job still running ...
2022/04/22 09:04:55 Failed to execute job: job 2022-04-22_01_59_53-16836000842276181880 failed
panic: Failed to execute job: job 2022-04-22_01_59_53-16836000842276181880 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203188, 0xc00019a000, 0x10e1911, 0x19, 0xc0003d5df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 25s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/pzwke5uu7n7m4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #486

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/486/display/redirect?page=changes>

Changes:

[vachan] Annotating Read API tests.

[bulat.safiullin] [BEAM-14247] [Website] add image

[bulat.safiullin] [BEAM-14247] [Website] center image

[mattcasters] BEAM-1857 : CHANGES.md entry for 2.38.0

[mmack] [BEAM-14323] Improve IDE integration of Spark cross version builds

[noreply] [BEAM-14112] Fixed ReadFromBigQuery with Interactive Beam (#17306)

[noreply] Update .asf.yaml (#17409)

[noreply] [BEAM-14336] Sickbay flight delays test - dataset seems to be missing

[noreply] [BEAM-14338] Update watermark unit tests to use time.Time.Equals()

[noreply] [BEAM-14328] Tweaks to "Differences from pandas" page (#17413)

[Andrew Pilloud] [BEAM-14253] Disable broken test pending Dataflow fix

[yiru] fix: BigQuery Storage Connector trace id population missing bracket

[noreply] [BEAM-14330] Temporarily disable the clusters auto-cleanup (#17400)

[noreply] Update Beam website to release 2.38.0 (#17378)

[noreply] [BEAM-14213] Add API and construction time validation for Batched DoFns

[noreply] Minor: Update release guide regarding archive.apache.org (#17419)

[noreply] [BEAM-14017] beam_PreCommit_CommunityMetrics_Cron test failing (#17396)


------------------------------------------
[...truncated 24.91 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650531581723277201/****\022@9c4dd5527024d5f3512519808676e0d17616c5558ef5f9bc0f849c69762e3320"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/21 08:59:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650531581723277201/model
2022/04/21 08:59:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0421065624"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650531581723277201/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650531581723277201/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0421065624",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/21 08:59:42 Submitted job: 2022-04-21_01_59_42-8330691779526288329
2022/04/21 08:59:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-21_01_59_42-8330691779526288329?project=apache-beam-testing
2022/04/21 08:59:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-21_01_59_42-8330691779526288329
2022/04/21 08:59:42 Job state: JOB_STATE_PENDING ...
2022/04/21 09:00:12 Job still running ...
2022/04/21 09:00:42 Job still running ...
2022/04/21 09:01:13 Job still running ...
2022/04/21 09:01:43 Job still running ...
2022/04/21 09:02:13 Job still running ...
2022/04/21 09:02:43 Failed to execute job: job 2022-04-21_01_59_42-8330691779526288329 failed
panic: Failed to execute job: job 2022-04-21_01_59_42-8330691779526288329 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203108, 0xc0000480c0, 0x10e1911, 0x19, 0xc00035fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 11s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/56hlf6y3nqvh2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #485

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/485/display/redirect?page=changes>

Changes:

[andyye333] Change func to PTransform

[noreply] Populate actual dataflow job id to bigquery write trace id (#17130)

[relax] mark static thread as a daemon thread

[noreply] [BEAM-13866] Add miscellaneous exec unit tests (#17363)


------------------------------------------
[...truncated 24.98 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650445190532782321/****\022@9c4dd5527024d5f3512519808676e0d17616c5558ef5f9bc0f849c69762e3320"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/20 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650445190532782321/model
2022/04/20 08:59:51 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0420065649"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650445190532782321/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650445190532782321/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0420065649",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/20 08:59:51 Submitted job: 2022-04-20_01_59_51-5299180278738528633
2022/04/20 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-20_01_59_51-5299180278738528633?project=apache-beam-testing
2022/04/20 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-20_01_59_51-5299180278738528633
2022/04/20 08:59:51 Job state: JOB_STATE_PENDING ...
2022/04/20 09:00:21 Job still running ...
2022/04/20 09:00:51 Job still running ...
2022/04/20 09:01:21 Job still running ...
2022/04/20 09:01:51 Job still running ...
2022/04/20 09:02:21 Job still running ...
2022/04/20 09:02:52 Failed to execute job: job 2022-04-20_01_59_51-5299180278738528633 failed
panic: Failed to execute job: job 2022-04-20_01_59_51-5299180278738528633 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203108, 0xc0000480c0, 0x10e1911, 0x19, 0xc00055ddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/c7bn75tfjrzzm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #484

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/484/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14251] add output_coder_override to ExpansionRequest

[Heejong Lee] remove null

[rarokni] [BEAM-14307] Fix Slow Side input pattern bug in sample

[Heejong Lee] better error msg

[Heejong Lee] update from comments

[noreply] [BEAM-14316] Introducing KafkaIO.Read implementation compatibility

[noreply] [BEAM-14290] Address staticcheck warnings in the reflectx package

[noreply] [BEAM-14302] Simply bools in fn.go, genx_test.go (#17356)

[noreply] Merge pull request #17382: [BEAM-12356] Close DatasetService leak as


------------------------------------------
[...truncated 25.03 KB...]
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650358792523074022/****\022@9c4dd5527024d5f3512519808676e0d17616c5558ef5f9bc0f849c69762e3320"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/19 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650358792523074022/model
2022/04/19 08:59:53 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0419065645"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650358792523074022/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650358792523074022/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0419065645",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/19 08:59:53 Submitted job: 2022-04-19_01_59_53-10419082490599346020
2022/04/19 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-19_01_59_53-10419082490599346020?project=apache-beam-testing
2022/04/19 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-19_01_59_53-10419082490599346020
2022/04/19 08:59:53 Job state: JOB_STATE_PENDING ...
2022/04/19 09:00:23 Job still running ...
2022/04/19 09:00:54 Job still running ...
2022/04/19 09:01:24 Job still running ...
2022/04/19 09:01:54 Job still running ...
2022/04/19 09:02:24 Job still running ...
2022/04/19 09:02:54 Job still running ...
2022/04/19 09:03:24 Failed to execute job: job 2022-04-19_01_59_53-10419082490599346020 failed
panic: Failed to execute job: job 2022-04-19_01_59_53-10419082490599346020 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203108, 0xc000120000, 0x10e1911, 0x19, 0xc0004f1df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/p3lsp5xr62zso

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #483

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/483/display/redirect>

Changes:


------------------------------------------
[...truncated 25.04 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650272383145910593/****\022@8c94fb9e96cd1d6d0661868c9be38f3125ce31b7ebba4b014ea647cd1176ddc5"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/18 08:59:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650272383145910593/model
2022/04/18 08:59:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0418065636"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650272383145910593/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650272383145910593/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0418065636",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/18 08:59:45 Submitted job: 2022-04-18_01_59_43-810683589754287405
2022/04/18 08:59:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-18_01_59_43-810683589754287405?project=apache-beam-testing
2022/04/18 08:59:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-18_01_59_43-810683589754287405
2022/04/18 08:59:45 Job state: JOB_STATE_PENDING ...
2022/04/18 09:00:15 Job still running ...
2022/04/18 09:00:45 Job still running ...
2022/04/18 09:01:15 Job still running ...
2022/04/18 09:01:45 Job still running ...
2022/04/18 09:02:15 Job still running ...
2022/04/18 09:02:45 Failed to execute job: job 2022-04-18_01_59_43-810683589754287405 failed
panic: Failed to execute job: job 2022-04-18_01_59_43-810683589754287405 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203108, 0xc00019a000, 0x10e1911, 0x19, 0xc00083fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vhcevlaiikosa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #482

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/482/display/redirect>

Changes:


------------------------------------------
[...truncated 25.05 KB...]
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650185983024472555/****\022@8c94fb9e96cd1d6d0661868c9be38f3125ce31b7ebba4b014ea647cd1176ddc5"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/17 08:59:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650185983024472555/model
2022/04/17 08:59:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0417065631"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650185983024472555/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650185983024472555/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0417065631",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/17 08:59:44 Submitted job: 2022-04-17_01_59_43-2718758616642052438
2022/04/17 08:59:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-17_01_59_43-2718758616642052438?project=apache-beam-testing
2022/04/17 08:59:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-17_01_59_43-2718758616642052438
2022/04/17 08:59:44 Job state: JOB_STATE_PENDING ...
2022/04/17 09:00:14 Job still running ...
2022/04/17 09:00:44 Job still running ...
2022/04/17 09:01:14 Job still running ...
2022/04/17 09:01:44 Job still running ...
2022/04/17 09:02:14 Job still running ...
2022/04/17 09:02:44 Job still running ...
2022/04/17 09:03:14 Failed to execute job: job 2022-04-17_01_59_43-2718758616642052438 failed
panic: Failed to execute job: job 2022-04-17_01_59_43-2718758616642052438 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203108, 0xc0000480c0, 0x10e1911, 0x19, 0xc000855df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bcxejmamay3fa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #481

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/481/display/redirect?page=changes>

Changes:

[pandiana] BigQueryServicesImpl: reduce number of threads spawned by

[noreply] [BEAM-13204] Fix website bug where code tabs do not appear if the


------------------------------------------
[...truncated 25.22 KB...]
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650099583149538404/****\022@8c94fb9e96cd1d6d0661868c9be38f3125ce31b7ebba4b014ea647cd1176ddc5"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/16 08:59:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650099583149538404/model
2022/04/16 08:59:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0416065640"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650099583149538404/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650099583149538404/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0416065640",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/16 08:59:44 Submitted job: 2022-04-16_01_59_43-8660703551313879673
2022/04/16 08:59:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-16_01_59_43-8660703551313879673?project=apache-beam-testing
2022/04/16 08:59:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-16_01_59_43-8660703551313879673
2022/04/16 08:59:44 Job state: JOB_STATE_PENDING ...
2022/04/16 09:00:14 Job still running ...
2022/04/16 09:00:44 Job still running ...
2022/04/16 09:01:14 Job still running ...
2022/04/16 09:01:44 Job still running ...
2022/04/16 09:02:14 Job still running ...
2022/04/16 09:02:44 Job still running ...
2022/04/16 09:03:14 Job still running ...
2022/04/16 09:03:44 Job still running ...
2022/04/16 09:04:14 Job still running ...
2022/04/16 09:04:44 Job still running ...
2022/04/16 09:05:14 Job still running ...
2022/04/16 09:05:44 Failed to execute job: job 2022-04-16_01_59_43-8660703551313879673 failed
panic: Failed to execute job: job 2022-04-16_01_59_43-8660703551313879673 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203108, 0xc000198000, 0x10e1911, 0x19, 0xc0003d3df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fcj5ra2fs4n5u

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #480

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/480/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Upgrade to Gradle 7.4

[Kenneth Knowles] Remove Python module dependency on Dataflow worker

[noreply] [BEAM-13925] Dont double assign committers if author or other reviewer

[noreply] [BEAM-13739] Remove deprecated shallow clone funcs (#17362)

[noreply] [BEAM-11104] Pipe Continuation to DataSource level (#17334)

[noreply] [BEAM-11105] Basic Watermark Estimation (Wall Clock Observing) (#17267)

[noreply] Respect output coder for TextIO. (#17367)

[noreply] Merge pull request #17200 from [BEAM-12164]: fix the autoscaling backlog

[noreply] [BEAM-17035] Call python3 directly when it is available. (#17366)

[noreply] Merge pull request #17375: [BEAM-8691] Declare newer


------------------------------------------
[...truncated 25.01 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650013188604806022/****\022@8c94fb9e96cd1d6d0661868c9be38f3125ce31b7ebba4b014ea647cd1176ddc5"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/15 08:59:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650013188604806022/model
2022/04/15 08:59:49 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0415065639"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650013188604806022/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650013188604806022/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0415065639",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/15 08:59:49 Submitted job: 2022-04-15_01_59_49-10318977953270179666
2022/04/15 08:59:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-15_01_59_49-10318977953270179666?project=apache-beam-testing
2022/04/15 08:59:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-15_01_59_49-10318977953270179666
2022/04/15 08:59:49 Job state: JOB_STATE_PENDING ...
2022/04/15 09:00:19 Job still running ...
2022/04/15 09:00:49 Job still running ...
2022/04/15 09:01:19 Job still running ...
2022/04/15 09:01:49 Job still running ...
2022/04/15 09:02:19 Job still running ...
2022/04/15 09:02:50 Failed to execute job: job 2022-04-15_01_59_49-10318977953270179666 failed
panic: Failed to execute job: job 2022-04-15_01_59_49-10318977953270179666 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203108, 0xc0000480c0, 0x10e1911, 0x19, 0xc000579df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 23s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/k6v2bgkhmxcne

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #479

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/479/display/redirect?page=changes>

Changes:

[relax] handle changing schemas in Storage API sink

[noreply] Fix a couple style issues (#17361)

[noreply] [BEAM-14287] Clean up staticcheck warnings in graph/coder (#17337)

[noreply] Improvements to dataflow job service for non-Python jobs. (#17338)

[noreply] Bump minimist (#17290)

[noreply] Bump ansi-regex (#17291)

[noreply] Bump nanoid (#17292)

[noreply] Bump lodash (#17293)

[noreply] Bump url-parse (#17294)

[noreply] Bump moment (#17328)

[noreply] Merge pull request #15549 from [BEAM-11997] Changed RedisIO


------------------------------------------
[...truncated 26.18 KB...]
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/14 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649926789751906253/model
2022/04/14 08:59:50 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0414065648"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649926789751906253/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649926789751906253/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0414065648",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/14 08:59:50 Submitted job: 2022-04-14_01_59_50-9194601017906236062
2022/04/14 08:59:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-14_01_59_50-9194601017906236062?project=apache-beam-testing
2022/04/14 08:59:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-14_01_59_50-9194601017906236062
2022/04/14 08:59:50 Job state: JOB_STATE_PENDING ...
2022/04/14 09:00:20 Job still running ...
2022/04/14 09:00:51 Job still running ...
2022/04/14 09:01:21 Job still running ...
2022/04/14 09:01:51 Job still running ...
2022/04/14 09:02:21 Job still running ...
2022/04/14 09:02:51 Job still running ...
2022/04/14 09:03:21 Job still running ...
2022/04/14 09:03:51 Job still running ...
2022/04/14 09:04:21 Job still running ...
2022/04/14 09:04:51 Job still running ...
2022/04/14 09:05:21 Job still running ...
2022/04/14 09:05:51 Job still running ...
2022/04/14 09:06:21 Job still running ...
2022/04/14 09:06:51 Job still running ...
2022/04/14 09:07:22 Job still running ...
2022/04/14 09:07:52 Job still running ...
2022/04/14 09:08:22 Job still running ...
2022/04/14 09:08:52 Job still running ...
2022/04/14 09:09:22 Job still running ...
2022/04/14 09:09:52 Job still running ...
2022/04/14 09:10:22 Job still running ...
2022/04/14 09:10:52 Job still running ...
2022/04/14 09:11:22 Job still running ...
2022/04/14 09:11:52 Job still running ...
2022/04/14 09:12:22 Job still running ...
2022/04/14 09:12:52 Job still running ...
2022/04/14 09:13:22 Job still running ...
2022/04/14 09:13:52 Job still running ...
2022/04/14 09:14:22 Job still running ...
2022/04/14 09:14:52 Job still running ...
2022/04/14 09:15:22 Failed to execute job: job 2022-04-14_01_59_50-9194601017906236062 failed
panic: Failed to execute job: job 2022-04-14_01_59_50-9194601017906236062 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11feac8, 0xc0000480c0, 0x10dda39, 0x19, 0xc0003e7df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 15m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/3jzy42u7ujyf4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #478

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/478/display/redirect?page=changes>

Changes:

[Valentyn Tymofieiev] Add remaining Dataflow test suites for Python 3.9.

[Heejong Lee] [BEAM-14232] Only resolve artifacts in expanded environments for Java

[noreply] Fix test ordering issue (#17350)

[buqian] Do not pass null to MoreObjects.firstNonNull as default value

[ningkang0957] [BEAM-14288] Fixed flaky test

[noreply] [BEAM-14277] Disables Spanner change streams tests (#17346)

[noreply] [BEAM-14219] Run cleanup script to remove stale prebuilt SDK container

[Heejong Lee] [BEAM-14300] Fix Java precommit failure

[noreply] [BEAM-14116] Rollback "Chunk commit requests dynamically (#17004)"

[noreply] [BEAM-13982] A base class for run inference (#16970)

[ningkang0957] Enumerates all possible expected strings when asserting

[noreply] [BEAM-13966] Add pivot(), a non-deferred column operation on categorical


------------------------------------------
[...truncated 25.03 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649840388837942116/****\022@2635302268f7082d77b7ad1b0549b97ff64db98ba1b5daef960b254b2fbf8ca4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/13 08:59:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649840388837942116/model
2022/04/13 08:59:49 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0413065639"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649840388837942116/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649840388837942116/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0413065639",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/13 08:59:49 Submitted job: 2022-04-13_01_59_49-10856936589278675616
2022/04/13 08:59:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-13_01_59_49-10856936589278675616?project=apache-beam-testing
2022/04/13 08:59:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-13_01_59_49-10856936589278675616
2022/04/13 08:59:50 Job state: JOB_STATE_PENDING ...
2022/04/13 09:00:20 Job still running ...
2022/04/13 09:00:50 Job still running ...
2022/04/13 09:01:20 Job still running ...
2022/04/13 09:01:50 Job still running ...
2022/04/13 09:02:20 Job still running ...
2022/04/13 09:02:50 Failed to execute job: job 2022-04-13_01_59_49-10856936589278675616 failed
panic: Failed to execute job: job 2022-04-13_01_59_49-10856936589278675616 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11feac8, 0xc0000480c0, 0x10dda39, 0x19, 0xc000607df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/liokfci3fn4dg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #477

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/477/display/redirect?page=changes>

Changes:

[kamil.bregula] [BEAM-14215] Improve argument validation in SnowflakeIO

[benjamin.gonzalez] [BEAM-14013] Add PreCommit Kotlin examples Jenkins Job

[Andrew Pilloud] [BEAM-13151] Support multiple layers of AutoValue nesting

[Heejong Lee] [BEAM-14233] Merge requirements from expanded response for Java External

[benjamin.gonzalez] [BEAM-14013] Add spark, direct, flink runners as triggers for Kotlin

[noreply] [BEAM-13898] Add tests to the pubsubx package. (#17324)

[noreply] [BEAM-14285] Clean up Staticcheck Warnings in io packages (#17336)

[noreply] [BEAM-14187] Fix concurrency issue in IsmReaderImpl (#17201)

[noreply] [BEAM-14288] Skip flaking test

[noreply] Simplify specifying additional dependencies in Go SDK in XLang IOs

[noreply] [BEAM-14240] Clean staticcheck warnings in runner packages (#17340)

[Daniel Oliveira] [BEAM-13538] Workaround to fix go-licenses crash.


------------------------------------------
[...truncated 25.11 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649753993056065560/****\022@2635302268f7082d77b7ad1b0549b97ff64db98ba1b5daef960b254b2fbf8ca4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/12 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649753993056065560/model
2022/04/12 08:59:53 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0412065647"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649753993056065560/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649753993056065560/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0412065647",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/12 08:59:54 Submitted job: 2022-04-12_01_59_53-15779564578901299148
2022/04/12 08:59:54 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-12_01_59_53-15779564578901299148?project=apache-beam-testing
2022/04/12 08:59:54 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-12_01_59_53-15779564578901299148
2022/04/12 08:59:54 Job state: JOB_STATE_PENDING ...
2022/04/12 09:00:24 Job still running ...
2022/04/12 09:00:54 Job still running ...
2022/04/12 09:01:24 Job still running ...
2022/04/12 09:01:54 Job still running ...
2022/04/12 09:02:24 Job still running ...
2022/04/12 09:02:54 Job still running ...
2022/04/12 09:03:24 Job still running ...
2022/04/12 09:03:54 Job still running ...
2022/04/12 09:04:24 Job still running ...
2022/04/12 09:04:55 Failed to execute job: job 2022-04-12_01_59_53-15779564578901299148 failed
panic: Failed to execute job: job 2022-04-12_01_59_53-15779564578901299148 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11feac8, 0xc000120000, 0x10dda39, 0x19, 0xc00030bdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 23s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/sju45o2eydx22

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #476

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/476/display/redirect>

Changes:


------------------------------------------
[...truncated 25.15 KB...]
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649667590841001937/****\022@3fc352ace7526fc5069680e0a7ad182328fce19a1b6fab690665cba1f8b2d24b"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/11 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649667590841001937/model
2022/04/11 08:59:51 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0411065642"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649667590841001937/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649667590841001937/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0411065642",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/11 08:59:52 Submitted job: 2022-04-11_01_59_51-13952824778709477264
2022/04/11 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-11_01_59_51-13952824778709477264?project=apache-beam-testing
2022/04/11 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-11_01_59_51-13952824778709477264
2022/04/11 08:59:52 Job state: JOB_STATE_PENDING ...
2022/04/11 09:00:22 Job still running ...
2022/04/11 09:00:52 Job still running ...
2022/04/11 09:01:22 Job still running ...
2022/04/11 09:01:52 Job still running ...
2022/04/11 09:02:22 Job still running ...
2022/04/11 09:02:52 Job still running ...
2022/04/11 09:03:22 Job still running ...
2022/04/11 09:03:52 Job still running ...
2022/04/11 09:04:22 Job still running ...
2022/04/11 09:04:52 Job still running ...
2022/04/11 09:05:22 Failed to execute job: job 2022-04-11_01_59_51-13952824778709477264 failed
panic: Failed to execute job: job 2022-04-11_01_59_51-13952824778709477264 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fd328, 0xc00019a000, 0x10dc4e5, 0x19, 0xc000485df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/cvwcq24l352pw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #475

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/475/display/redirect?page=changes>

Changes:

[chamikaramj] Re-raise exceptions swallowed in several Python I/O connectors

[noreply] Merge pull request #16928: [BEAM-11971] Re add reverted timer


------------------------------------------
[...truncated 25.02 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649581191433292544/****\022@3fc352ace7526fc5069680e0a7ad182328fce19a1b6fab690665cba1f8b2d24b"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/10 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649581191433292544/model
2022/04/10 08:59:52 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0410065644"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649581191433292544/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649581191433292544/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0410065644",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/10 08:59:52 Submitted job: 2022-04-10_01_59_52-18117659668995389287
2022/04/10 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-10_01_59_52-18117659668995389287?project=apache-beam-testing
2022/04/10 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-10_01_59_52-18117659668995389287
2022/04/10 08:59:52 Job state: JOB_STATE_PENDING ...
2022/04/10 09:00:22 Job still running ...
2022/04/10 09:00:52 Job still running ...
2022/04/10 09:01:22 Job still running ...
2022/04/10 09:01:52 Job still running ...
2022/04/10 09:02:22 Job still running ...
2022/04/10 09:02:53 Failed to execute job: job 2022-04-10_01_59_52-18117659668995389287 failed
panic: Failed to execute job: job 2022-04-10_01_59_52-18117659668995389287 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fd328, 0xc0000480c0, 0x10dc4e5, 0x19, 0xc0005b3df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/j4gwvwr52nfhu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #474

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/474/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-11714] Change spotBugs jenkins config

[Robert Bradshaw] Cleanup docs on Shared.

[Kyle Weaver] Nit: correct description for precommit cron jobs.

[benjamin.gonzalez] [BEAM-11714] Add dummy class for testing

[benjamin.gonzalez] [BEAM-11714] Remove dummy class used for testing

[benjamin.gonzalez] [BEAM-11714] Spotbugs print toJenkins UI precommit_Java17

[noreply] [BEAM-13767] Remove eclipse plugin as it generates a lot of unused tasks

[noreply] [BEAM-10708] Updated beam_sql error message (#17314)

[noreply] [BEAM-14281] add as_deterministic_coder to nullable coder (#17322)

[noreply] Improvements to Beam/Spark quickstart. (#17129)

[chamikaramj] Disable BigQueryIOStorageWriteIT for Runner v2 test suite


------------------------------------------
[...truncated 25.17 KB...]
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649494790908290020/****\022@3fc352ace7526fc5069680e0a7ad182328fce19a1b6fab690665cba1f8b2d24b"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/09 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649494790908290020/model
2022/04/09 08:59:51 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0409065651"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649494790908290020/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649494790908290020/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0409065651",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/09 08:59:52 Submitted job: 2022-04-09_01_59_51-18230691256320765722
2022/04/09 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-09_01_59_51-18230691256320765722?project=apache-beam-testing
2022/04/09 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-09_01_59_51-18230691256320765722
2022/04/09 08:59:52 Job state: JOB_STATE_PENDING ...
2022/04/09 09:00:22 Job still running ...
2022/04/09 09:00:52 Job still running ...
2022/04/09 09:01:22 Job still running ...
2022/04/09 09:01:53 Job still running ...
2022/04/09 09:02:23 Job still running ...
2022/04/09 09:02:53 Job still running ...
2022/04/09 09:03:23 Job still running ...
2022/04/09 09:03:53 Job still running ...
2022/04/09 09:04:23 Job still running ...
2022/04/09 09:04:53 Job still running ...
2022/04/09 09:05:23 Failed to execute job: job 2022-04-09_01_59_51-18230691256320765722 failed
panic: Failed to execute job: job 2022-04-09_01_59_51-18230691256320765722 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fd328, 0xc0000480c0, 0x10dc4e5, 0x19, 0xc0005eddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ayf2lcfl5sb3c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #473

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/473/display/redirect?page=changes>

Changes:

[johnjcasey] [BEAM-10529] add java and generic components of nullable xlang tests

[johnjcasey] [BEAM-10529] fix test case

[johnjcasey] [BEAM-10529] add coders and typehints to support nullable xlang coders

[johnjcasey] [BEAM-10529] update external builder to support nullable coder

[johnjcasey] [BEAM-10529] clean up coders.py

[johnjcasey] [BEAM-10529] add coder translation test

[johnjcasey] [BEAM-10529] add additional check to typecoder to not accidentally

[johnjcasey] [BEAM-10529] add test to retrieve nullable coder from typehint

[johnjcasey] [BEAM-10529] run spotless

[johnjcasey] [BEAM-10529] add go nullable coder

[johnjcasey] [BEAM-10529] cleanup extra println

[johnjcasey] [BEAM-10529] improve comments, clean up python

[bulat.safiullin] [BEAM-13992] [Website] update Contribute/Code Contribution Guide page

[bulat.safiullin] [BEAM-13992] [Website] change text, transfer tag a

[bulat.safiullin] [BEAM-13992] [Website] change code tags

[bulat.safiullin] [BEAM-13992] [Website] change text

[bulat.safiullin] [BEAM-13992] [Website] change text and links, add empty lines

[bulat.safiullin] [BEAM-13991] [Website] change links, add contribute file

[bulat.safiullin] [BEAM-13991] [Website] add content, add styles

[bulat.safiullin] [BEAM-13991] [Website] add images, add styles, delete spaces

[bulat.safiullin] [BEAM-13991] [Website] change url and aliases, delete bullet points

[bulat.safiullin] [BEAM-13991] [Website] add empty line

[bulat.safiullin] [BEAM-13992] [Website] change links, change text

[bulat.safiullin] [BEAM-13992] [Website] change links, add text, add dots

[bulat.safiullin] [BEAM-13992] [Website] change links, change text

[bulat.safiullin] [BEAM-13991] [Website] change styles, change quotes

[bulat.safiullin] [BEAM-13991] [Website] change link color

[bulat.safiullin] [BEAM-13992] [Website] change text, delete whitespace

[bulat.safiullin] [BEAM-13991] [Website] change text

[bulat.safiullin] [BEAM-13992] [Website] update text

[bulat.safiullin] [BEAM-13991] [Website] added changes from PR 13992, changed get-starting

[shivrajw] [BEAM-14236] Parquet IO support for list to conform with Apache Parquet

[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -

[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -

[mmack] [BEAM-14104] Support shard aware aggregation in Kinesis writer.

[noreply] [BEAM-13015] Lookup the container for the step once when registering

[noreply] [BEAM-14175] Log read loop abort at debug rather than error (#17183)

[noreply] [BEAM-11745] Fix author list rendering (#17308)

[noreply] [BEAM-14144] Record JFR profiles when GC thrashing is detected (#17151)

[noreply] Factors enable_prime flag in when checking use_unified_worker conditions

[noreply] [BEAM-11104] Add ProcessContinuation type to Go SDK (#17265)

[noreply] BEAM-13939: Restructure Protos to fix namespace conflicts (#16961)

[noreply] [BEAM-14270] Mark {Snowflake/BigQuery}Services as @Internal (#17309)

[noreply] [BEAM-13901] Add unit tests for graphx/cogbk.go

[noreply] [BEAM-14259, BEAM-14266] Remove unused function, replace use of ptypes

[noreply] [BEAM-14274] Fix staticcheck warnings in pipelinex (#17311)

[noreply] [BEAM-13857] Switched Go IT script to using Go flags for expansion

[noreply] Update python beam-master container image. (#17313)


------------------------------------------
[...truncated 24.92 KB...]
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649408400973609927/****\022@3fc352ace7526fc5069680e0a7ad182328fce19a1b6fab690665cba1f8b2d24b"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/08 09:00:01 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649408400973609927/model
2022/04/08 09:00:01 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0408065639"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649408400973609927/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649408400973609927/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0408065639",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/08 09:00:02 Submitted job: 2022-04-08_02_00_01-1546961767410462433
2022/04/08 09:00:02 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-08_02_00_01-1546961767410462433?project=apache-beam-testing
2022/04/08 09:00:02 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-08_02_00_01-1546961767410462433
2022/04/08 09:00:02 Job state: JOB_STATE_PENDING ...
2022/04/08 09:00:32 Job still running ...
2022/04/08 09:01:02 Job still running ...
2022/04/08 09:01:32 Job still running ...
2022/04/08 09:02:02 Job still running ...
2022/04/08 09:02:32 Job still running ...
2022/04/08 09:03:02 Job still running ...
2022/04/08 09:03:32 Failed to execute job: job 2022-04-08_02_00_01-1546961767410462433 failed
panic: Failed to execute job: job 2022-04-08_02_00_01-1546961767410462433 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fd328, 0xc0000480c0, 0x10dc4e5, 0x19, 0xc0007b1df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ytcthnuwjpeha

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #472

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/472/display/redirect?page=changes>

Changes:

[noreply] Avoid pr-bot state desync (#17299)

[noreply] [BEAM-14259] Clean up staticcheck warnings in the exec package (#17285)

[noreply] Minor: Prefer registered schema in SQL docs (#17298)

[Kyle Weaver] [BEAM-14262] Update plugins for Dockerized Jenkins.

[Kyle Weaver] Add ansicolor and ws-cleanup plugins.

[noreply] [Playground] add meta tags (#17207)

[noreply] fixes golint and deprecated issues in recent Go SDK import (#17304)

[noreply] [BEAM-14266] Replace deprecated ptypes package uses (#17302)

[noreply] [BEAM-11936] Fix rawtypes warnings in SnowflakeIO (#17257)

[noreply] Merge pull request #17262: [BEAM-14244] Use the supplied output


------------------------------------------
[...truncated 25.09 KB...]
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649321991738246498/****\022@575116b4d9ad793dce127ce73af9b0aaf5a4813a1215f17c7ba1244a6efe738f"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/07 08:59:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649321991738246498/model
2022/04/07 08:59:52 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0407065627"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649321991738246498/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649321991738246498/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0407065627",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/07 08:59:52 Submitted job: 2022-04-07_01_59_52-12006377050527924371
2022/04/07 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-07_01_59_52-12006377050527924371?project=apache-beam-testing
2022/04/07 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-07_01_59_52-12006377050527924371
2022/04/07 08:59:52 Job state: JOB_STATE_PENDING ...
2022/04/07 09:00:22 Job still running ...
2022/04/07 09:00:53 Job still running ...
2022/04/07 09:01:23 Job still running ...
2022/04/07 09:01:53 Job still running ...
2022/04/07 09:02:23 Job still running ...
2022/04/07 09:02:53 Job still running ...
2022/04/07 09:03:23 Failed to execute job: job 2022-04-07_01_59_52-12006377050527924371 failed
panic: Failed to execute job: job 2022-04-07_01_59_52-12006377050527924371 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11f8ce8, 0xc0000480c0, 0x10d8598, 0x19, 0xc000407df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/zo37npjtprfdk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #471

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/471/display/redirect?page=changes>

Changes:

[bingyeli] update query

[Robert Bradshaw] [BEAM-14250] Fix coder registration for types defined in __main__.

[johnjcasey] [BEAM-14256] update SpEL dependency to 5.3.18.RELEASE

[johnjcasey] [BEAM-14256] remove .RELEASE

[dannymccormick] Fix dependency issue causing failures

[Kyle Weaver] [BEAM-9649] Add region option to Mongo Dataflow test.

[noreply] Allow get_coder(None).

[noreply] [BEAM-13015] Disable retries for fnapi grpc channels which otherwise

[noreply] [BEAM-13952] Sickbay

[noreply] BEAM-14235 parquetio module does not parse PEP-440 compliant Pyarrow

[noreply] [Website] Contribution guide page indent bug fix (#17287)

[noreply] [BEAM-10976] Document go sdk bundle finalization (#17048)

[noreply] [BEAM-13829] Expose status API from Go SDK Harness (#16957)


------------------------------------------
[...truncated 25.18 KB...]
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649235594700425203/****\022@37be6221dfe5aacc3816c06a4f0007660dd1e65bafb7773689324ef03cae73f6"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/06 08:59:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649235594700425203/model
2022/04/06 08:59:55 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0406065652"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649235594700425203/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649235594700425203/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0406065652",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/06 08:59:55 Submitted job: 2022-04-06_01_59_55-15138004679916702609
2022/04/06 08:59:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-06_01_59_55-15138004679916702609?project=apache-beam-testing
2022/04/06 08:59:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-06_01_59_55-15138004679916702609
2022/04/06 08:59:55 Job state: JOB_STATE_PENDING ...
2022/04/06 09:00:25 Job still running ...
2022/04/06 09:00:55 Job still running ...
2022/04/06 09:01:25 Job still running ...
2022/04/06 09:01:56 Job still running ...
2022/04/06 09:02:26 Job still running ...
2022/04/06 09:02:56 Job still running ...
2022/04/06 09:03:26 Job still running ...
2022/04/06 09:03:56 Job still running ...
2022/04/06 09:04:26 Job still running ...
2022/04/06 09:04:56 Job still running ...
2022/04/06 09:05:26 Job still running ...
2022/04/06 09:05:56 Failed to execute job: job 2022-04-06_01_59_55-15138004679916702609 failed
panic: Failed to execute job: job 2022-04-06_01_59_55-15138004679916702609 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11f8c68, 0xc000120000, 0x10d8598, 0x19, 0xc000227df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 25s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/uj76yjdhggcdu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #470

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/470/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-8970] Add docs to run wordcount example on portable Spark Runner

[Kiley Sok] Update python container version

[benjamin.gonzalez] [BEAM-8970] Add period to end of sentence

[Kyle Weaver] Add self-descriptive message for expected errors.

[noreply] Add --dataflowServiceOptions=enable_prime to useUnifiedWorker conditions

[noreply] [BEAM-10529] nullable xlang coder (#16923)

[noreply] Fix go fmt break in core/typex/special.go (#17266)

[noreply] [BEAM-5436] Add doc page on Go cross compilation. (#17256)

[noreply] Pr-bot Don't count all reviews as approvals (#17269)

[noreply] Fix postcommits (#17263)

[noreply] [BEAM-14241] Address staticcheck warnings in boot.go (#17264)

[noreply] [BEAM-14157] GrpcWindmillServer: Use stream specific boolean to do

[noreply] [BEAM-10582] Allow (and test) pyarrow 7 (#17229)

[noreply] [BEAM-13519] Solve race issues when the server responds with an error


------------------------------------------
[...truncated 25.20 KB...]
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649149267944574724/****\022@9e5daaa3bfec104f57d0624a23c7129ebd58208bae8714ba3b1701842f4e8727"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/05 09:01:13 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649149267944574724/model
2022/04/05 09:01:13 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0405065701"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649149267944574724/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649149267944574724/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0405065701",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/05 09:01:14 Submitted job: 2022-04-05_02_01_13-8648974451529159859
2022/04/05 09:01:14 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-05_02_01_13-8648974451529159859?project=apache-beam-testing
2022/04/05 09:01:14 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-05_02_01_13-8648974451529159859
2022/04/05 09:01:14 Job state: JOB_STATE_PENDING ...
2022/04/05 09:01:44 Job still running ...
2022/04/05 09:02:14 Job still running ...
2022/04/05 09:02:44 Job still running ...
2022/04/05 09:03:14 Job still running ...
2022/04/05 09:03:44 Job still running ...
2022/04/05 09:04:14 Job still running ...
2022/04/05 09:04:44 Job still running ...
2022/04/05 09:05:14 Job still running ...
2022/04/05 09:05:44 Job still running ...
2022/04/05 09:06:14 Job still running ...
2022/04/05 09:06:45 Failed to execute job: job 2022-04-05_02_01_13-8648974451529159859 failed
panic: Failed to execute job: job 2022-04-05_02_01_13-8648974451529159859 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11577c8, 0xc000198000, 0x104449e, 0x19, 0xc000495df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 7m 10s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/uqufveol2qzoy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #469

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/469/display/redirect>

Changes:


------------------------------------------
[...truncated 25.00 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649062798997415282/****\022@3caf1d400dd2c2a06ac27842dd1751c899b7c709640db099b3a7a1de89697d43"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/04 08:59:59 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649062798997415282/model
2022/04/04 08:59:59 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0404065635"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649062798997415282/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649062798997415282/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0404065635",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/04 09:00:00 Submitted job: 2022-04-04_01_59_59-14203036862860459488
2022/04/04 09:00:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-04_01_59_59-14203036862860459488?project=apache-beam-testing
2022/04/04 09:00:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-04_01_59_59-14203036862860459488
2022/04/04 09:00:00 Job state: JOB_STATE_PENDING ...
2022/04/04 09:00:30 Job still running ...
2022/04/04 09:01:00 Job still running ...
2022/04/04 09:01:30 Job still running ...
2022/04/04 09:02:00 Job still running ...
2022/04/04 09:02:30 Job still running ...
2022/04/04 09:03:00 Job still running ...
2022/04/04 09:03:30 Failed to execute job: job 2022-04-04_01_59_59-14203036862860459488 failed
panic: Failed to execute job: job 2022-04-04_01_59_59-14203036862860459488 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11562c8, 0xc0000480c0, 0x1043139, 0x19, 0xc0000dbdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 1s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/yem5w76dekghc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #468

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/468/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14143] Simplifies the ExternalPythonTransform API (#17101)


------------------------------------------
[...truncated 25.00 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648976387672069728/****\022@3caf1d400dd2c2a06ac27842dd1751c899b7c709640db099b3a7a1de89697d43"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/03 08:59:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648976387672069728/model
2022/04/03 08:59:48 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0403065643"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648976387672069728/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648976387672069728/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0403065643",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/03 08:59:50 Submitted job: 2022-04-03_01_59_48-10952063442483176866
2022/04/03 08:59:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-03_01_59_48-10952063442483176866?project=apache-beam-testing
2022/04/03 08:59:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-03_01_59_48-10952063442483176866
2022/04/03 08:59:50 Job state: JOB_STATE_PENDING ...
2022/04/03 09:00:20 Job still running ...
2022/04/03 09:00:50 Job still running ...
2022/04/03 09:01:20 Job still running ...
2022/04/03 09:01:50 Job still running ...
2022/04/03 09:02:20 Job still running ...
2022/04/03 09:02:50 Job still running ...
2022/04/03 09:03:20 Failed to execute job: job 2022-04-03_01_59_48-10952063442483176866 failed
panic: Failed to execute job: job 2022-04-03_01_59_48-10952063442483176866 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11562c8, 0xc0000480c0, 0x1043139, 0x19, 0xc000561df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dy3dkw6ye5ifs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #467

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/467/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14133] Fix potential NPE in BigQueryServicesImpl.getErrorInfo

[Robert Bradshaw] Revert "Revert "[BEAM-14038] Auto-startup for Python expansion service.

[Robert Bradshaw] Skip failing test for now.

[Kyle Weaver] [BEAM-14225] load balance jenkins jobs

[noreply] [BEAM-14153] Reshuffled Row Coder PCollection used as Side Input cause

[noreply] delint go sdk (#17247)

[Heejong Lee] add test

[noreply] Merge pull request #16841 from [BEAM-8823] Make FnApiRunner work by

[noreply] [BEAM-14192] Update legacy container version (#17210)

[noreply] Fix mishandling of API with BQIO (#17211)

[noreply] [BEAM-14221] Update documentation with Flink on Dataproc features

[Kiley Sok] Revert "[BEAM-14190] Python sends dataflow schema field"


------------------------------------------
[...truncated 25.12 KB...]
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648889998523256868/****\022@3caf1d400dd2c2a06ac27842dd1751c899b7c709640db099b3a7a1de89697d43"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/02 08:59:59 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648889998523256868/model
2022/04/02 08:59:59 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0402065658"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648889998523256868/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648889998523256868/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0402065658",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/02 08:59:59 Submitted job: 2022-04-02_01_59_59-14339040222964691713
2022/04/02 08:59:59 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-02_01_59_59-14339040222964691713?project=apache-beam-testing
2022/04/02 08:59:59 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-02_01_59_59-14339040222964691713
2022/04/02 08:59:59 Job state: JOB_STATE_PENDING ...
2022/04/02 09:00:29 Job still running ...
2022/04/02 09:00:59 Job still running ...
2022/04/02 09:01:29 Job still running ...
2022/04/02 09:01:59 Job still running ...
2022/04/02 09:02:29 Job still running ...
2022/04/02 09:03:00 Job still running ...
2022/04/02 09:03:30 Job still running ...
2022/04/02 09:04:00 Job still running ...
2022/04/02 09:04:30 Job still running ...
2022/04/02 09:05:00 Job still running ...
2022/04/02 09:05:30 Job still running ...
2022/04/02 09:06:00 Failed to execute job: job 2022-04-02_01_59_59-14339040222964691713 failed
panic: Failed to execute job: job 2022-04-02_01_59_59-14339040222964691713 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11562c8, 0xc0000480c0, 0x1043139, 0x19, 0xc000315df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 28s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/i2w3or5houeow

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #466

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/466/display/redirect?page=changes>

Changes:

[bulat.safiullin] [BEAM-14164] [Website] change styles

[Andrew Pilloud] [BEAM-14190] Python sends dataflow schema field

[noreply] [BEAM-14179] Fix possibly null value

[noreply] [BEAM-12815] Try to fix flaky Flink Post Commit (#17227)

[noreply] Add a portable job server that proxies the Dataflow backend. (#17189)

[noreply] [BEAM-14130] Implement JupyterLab extension for managing Dataproc

[Andrew Pilloud] [BEAM-13741] Remove forced calcite dependency from BaseBeamTable

[noreply] [BEAM-13951] Update release guide with pointers on updating


------------------------------------------
[...truncated 25.64 KB...]
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648803590668068131/****\022@f6966c600443d516a9f3966976f3dac20ca870219b63f9dcae0766d1f2c13669"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/01 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648803590668068131/model
2022/04/01 08:59:51 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0401071150"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648803590668068131/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648803590668068131/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0401071150",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/01 08:59:51 Submitted job: 2022-04-01_01_59_51-14722547369570239050
2022/04/01 08:59:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-01_01_59_51-14722547369570239050?project=apache-beam-testing
2022/04/01 08:59:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-01_01_59_51-14722547369570239050
2022/04/01 08:59:51 Job state: JOB_STATE_PENDING ...
2022/04/01 09:00:21 Job still running ...
2022/04/01 09:00:51 Job still running ...
2022/04/01 09:01:22 Job still running ...
2022/04/01 09:01:52 Job still running ...
2022/04/01 09:02:22 Job still running ...
2022/04/01 09:02:52 Job still running ...
2022/04/01 09:03:22 Failed to execute job: job 2022-04-01_01_59_51-14722547369570239050 failed
panic: Failed to execute job: job 2022-04-01_01_59_51-14722547369570239050 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11545c8, 0xc0000480c0, 0x1041739, 0x19, 0xc000299df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...

Publishing failed.

The build scan server appears to be unavailable.
Please check https://status.gradle.com for the latest service status.

If the service is reported as available, please report this problem via https://gradle.com/help/plugin and include the following via copy/paste:

----------
Gradle version: 7.3.2
Plugin version: 3.4.1
Request URL: https://status.gradle.com
Request ID: 561b51f3-843a-4ba9-96c6-7244d652d982
Response status code: 405
Response server type: Varnish
----------

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #465

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/465/display/redirect?page=changes>

Changes:

[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn

[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn

[egalpin] [BEAM-14003] Adds compat for Elasticsearch 8.0.0

[egalpin] [BEAM-13136] Removes support for Elasticsearch 2.x

[noreply] Merge pull request #17149 from [BEAM-13883] [Playground] Increase test

[Kiley Sok] ignore test

[noreply] [BEAM-13948] Add unstack(), a non-deferred column operation on

[noreply] [BEAM-10976] Bundle finalization: E2E support (#17045)


------------------------------------------
[...truncated 25.09 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648717192610843512/****\022@f6966c600443d516a9f3966976f3dac20ca870219b63f9dcae0766d1f2c13669"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/31 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648717192610843512/model
2022/03/31 08:59:53 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0331071128"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648717192610843512/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648717192610843512/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0331071128",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/31 08:59:53 Submitted job: 2022-03-31_01_59_53-3532018229264391135
2022/03/31 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-31_01_59_53-3532018229264391135?project=apache-beam-testing
2022/03/31 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-31_01_59_53-3532018229264391135
2022/03/31 08:59:53 Job state: JOB_STATE_PENDING ...
2022/03/31 09:00:24 Job still running ...
2022/03/31 09:00:54 Job still running ...
2022/03/31 09:01:24 Job still running ...
2022/03/31 09:01:54 Job still running ...
2022/03/31 09:02:24 Job still running ...
2022/03/31 09:02:54 Job still running ...
2022/03/31 09:03:24 Job still running ...
2022/03/31 09:03:54 Job still running ...
2022/03/31 09:04:24 Job still running ...
2022/03/31 09:04:54 Job still running ...
2022/03/31 09:05:24 Failed to execute job: job 2022-03-31_01_59_53-3532018229264391135 failed
panic: Failed to execute job: job 2022-03-31_01_59_53-3532018229264391135 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11545c8, 0xc000120000, 0x1041739, 0x19, 0xc0002c7df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/qlas25ovxxmzo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #464

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/464/display/redirect?page=changes>

Changes:

[vachan] Update display data to include BQ information.

[noreply] Revert "[BEAM-14084] iterable_input_value_types changed from list to

[chamikaramj] Convert URLs to local jars when constructing filesToStage

[Valentyn Tymofieiev] Ensure the removed option prebuild_sdk_container_base_image not used on

[noreply] [BEAM-13314]Revise recommendations to manage Python pipeline

[noreply] Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for

[noreply] Merge pull request #17080 from [BEAM-13880] [Playground] Increase test

[noreply] Merge pull request #17050 from [BEAM-13877] [Playground] Increase test

[noreply] [BEAM-14200] Improve SamzaJobInvoker extensibility (#17212)

[noreply] Merge pull request #17148 from [BEAM-14042] [playground] Scroll imports

[noreply] [BEAM-13918] Increase datastoreio go sdk unit test coverage (#17173)

[noreply] Merge pull request #16819: [BEAM-13806] Adding test suite for Go x-lang


------------------------------------------
[...truncated 25.00 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648630900593060839/****\022@9990ddb428b105c428973d4b273df6cef4e95070f26a13c8c96360d918367eee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/30 09:01:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648630900593060839/model
2022/03/30 09:01:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0330065659"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648630900593060839/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648630900593060839/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0330065659",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/30 09:01:43 Submitted job: 2022-03-30_02_01_42-4760389848214798725
2022/03/30 09:01:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-30_02_01_42-4760389848214798725?project=apache-beam-testing
2022/03/30 09:01:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-30_02_01_42-4760389848214798725
2022/03/30 09:01:43 Job state: JOB_STATE_PENDING ...
2022/03/30 09:02:13 Job still running ...
2022/03/30 09:02:43 Job still running ...
2022/03/30 09:03:13 Job still running ...
2022/03/30 09:03:43 Job still running ...
2022/03/30 09:04:13 Job still running ...
2022/03/30 09:04:43 Job still running ...
2022/03/30 09:05:13 Failed to execute job: job 2022-03-30_02_01_42-4760389848214798725 failed
panic: Failed to execute job: job 2022-03-30_02_01_42-4760389848214798725 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc00019a000, 0x103ea75, 0x19, 0xc000509df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 2s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/czj7dtssnz7cw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #463

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/463/display/redirect?page=changes>

Changes:

[hengfeng] feat: remove the metadata table after the pipeline finishes

[thiagotnunes] test: add test for metadata table dropping

[noreply] Minor: Add warning about pubsub client to Beam 2.36.0 blog (#17188)

[noreply] [BEAM-14177] Fix GBK re-iteration caching for portable runners. (#17184)

[noreply] Merge pull request #17187: [BEAM-14181] Make sure to evict connections

[noreply] Only reset transform.label if it is correctly assigned (#17192)

[noreply] [BEAM-12641] Use google-auth instead of oauth2client for GCP auth

[Robert Bradshaw] [BEAM-14163] Fix typo in single core per container logic.

[thiagotnunes] test: disable SpannerIO.readChangeStream test

[noreply] Merge pull request #17164 from [BEAM-14140][Playground] Fix Deploy

[noreply] Merge pull request #16855 from [BEAM-13938][Playground] Increase test


------------------------------------------
[...truncated 25.02 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648544393874969070/****\022@9990ddb428b105c428973d4b273df6cef4e95070f26a13c8c96360d918367eee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/29 08:59:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648544393874969070/model
2022/03/29 08:59:54 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0329065711"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648544393874969070/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648544393874969070/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0329065711",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/29 08:59:55 Submitted job: 2022-03-29_01_59_54-13845046367261005507
2022/03/29 08:59:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-29_01_59_54-13845046367261005507?project=apache-beam-testing
2022/03/29 08:59:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-29_01_59_54-13845046367261005507
2022/03/29 08:59:55 Job state: JOB_STATE_PENDING ...
2022/03/29 09:00:25 Job still running ...
2022/03/29 09:00:55 Job still running ...
2022/03/29 09:01:26 Job still running ...
2022/03/29 09:01:56 Job still running ...
2022/03/29 09:02:26 Job still running ...
2022/03/29 09:02:56 Failed to execute job: job 2022-03-29_01_59_54-13845046367261005507 failed
panic: Failed to execute job: job 2022-03-29_01_59_54-13845046367261005507 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc0000480c0, 0x103ea75, 0x19, 0xc000403df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 29s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wlmp2vtvfbqwe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #462

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/462/display/redirect>

Changes:


------------------------------------------
[...truncated 25.11 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648457991104415867/****\022@9990ddb428b105c428973d4b273df6cef4e95070f26a13c8c96360d918367eee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/28 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648457991104415867/model
2022/03/28 08:59:51 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0328065632"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648457991104415867/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648457991104415867/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0328065632",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/28 08:59:52 Submitted job: 2022-03-28_01_59_51-7257195281805838344
2022/03/28 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-28_01_59_51-7257195281805838344?project=apache-beam-testing
2022/03/28 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-28_01_59_51-7257195281805838344
2022/03/28 08:59:52 Job state: JOB_STATE_PENDING ...
2022/03/28 09:00:22 Job still running ...
2022/03/28 09:00:52 Job still running ...
2022/03/28 09:01:22 Job still running ...
2022/03/28 09:01:52 Job still running ...
2022/03/28 09:02:22 Job still running ...
2022/03/28 09:02:52 Job still running ...
2022/03/28 09:03:22 Job still running ...
2022/03/28 09:03:52 Job still running ...
2022/03/28 09:04:22 Job still running ...
2022/03/28 09:04:52 Job still running ...
2022/03/28 09:05:22 Failed to execute job: job 2022-03-28_01_59_51-7257195281805838344 failed
panic: Failed to execute job: job 2022-03-28_01_59_51-7257195281805838344 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc000120000, 0x103ea75, 0x19, 0xc0004eddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/3jlqsudauxni6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #461

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/461/display/redirect>

Changes:


------------------------------------------
[...truncated 25.04 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648371586556523160/****\022@9990ddb428b105c428973d4b273df6cef4e95070f26a13c8c96360d918367eee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/27 08:59:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648371586556523160/model
2022/03/27 08:59:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0327065649"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648371586556523160/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648371586556523160/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0327065649",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/27 08:59:48 Submitted job: 2022-03-27_01_59_47-337753229541288753
2022/03/27 08:59:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-27_01_59_47-337753229541288753?project=apache-beam-testing
2022/03/27 08:59:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-27_01_59_47-337753229541288753
2022/03/27 08:59:48 Job state: JOB_STATE_PENDING ...
2022/03/27 09:00:18 Job still running ...
2022/03/27 09:00:48 Job still running ...
2022/03/27 09:01:18 Job still running ...
2022/03/27 09:01:48 Job still running ...
2022/03/27 09:02:18 Job still running ...
2022/03/27 09:02:48 Job still running ...
2022/03/27 09:03:19 Failed to execute job: job 2022-03-27_01_59_47-337753229541288753 failed
panic: Failed to execute job: job 2022-03-27_01_59_47-337753229541288753 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc0000480c0, 0x103ea75, 0x19, 0xc0004f7df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jou3726lawym6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #460

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/460/display/redirect?page=changes>

Changes:

[ryanthompson591] iterable_input_value_types will now be an iterable, I don't anticipate

[marco.robles] [BEAM-8218] PulsarIO Connector

[benjamin.gonzalez] [BEAM-12572] Change examples jobs to run as cron jobs

[benjamin.gonzalez] [BEAM-12572] SpotlessApply

[Robert Bradshaw] [BEAM-14171] More explicit asserts in CoGBKResult.

[Robert Bradshaw] Add some comments.

[noreply] [BEAM-14160] Parse filesToStage in Java expansion service (#17167)

[chamikaramj] Mapped JOB_STATE_RESOURCE_CLEANING_UP to RESOURCE_CLEANING_UP in Python

[noreply] Explicitly import estimator from tensorflow (#17168)


------------------------------------------
[...truncated 25.04 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648285186120095588/****\022@9990ddb428b105c428973d4b273df6cef4e95070f26a13c8c96360d918367eee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/26 08:59:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648285186120095588/model
2022/03/26 08:59:46 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0326065653"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648285186120095588/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648285186120095588/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0326065653",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/26 08:59:48 Submitted job: 2022-03-26_01_59_46-6258316545633872655
2022/03/26 08:59:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-26_01_59_46-6258316545633872655?project=apache-beam-testing
2022/03/26 08:59:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-26_01_59_46-6258316545633872655
2022/03/26 08:59:48 Job state: JOB_STATE_PENDING ...
2022/03/26 09:00:18 Job still running ...
2022/03/26 09:00:48 Job still running ...
2022/03/26 09:01:18 Job still running ...
2022/03/26 09:01:48 Job still running ...
2022/03/26 09:02:18 Job still running ...
2022/03/26 09:02:48 Job still running ...
2022/03/26 09:03:19 Failed to execute job: job 2022-03-26_01_59_46-6258316545633872655 failed
panic: Failed to execute job: job 2022-03-26_01_59_46-6258316545633872655 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc000120000, 0x103ea75, 0x19, 0xc0005bbdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dbfcth2ewrpus

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #459

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/459/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-14139] Drop support for Flink 1.11.

[Kyle Weaver] [BEAM-14139] Remove obsolete reference to Flink 1.11.

[Kyle Weaver] [BEAM-14139] Update list of supported Flink versions.

[Kyle Weaver] [BEAM-14139] Update CHANGES.md

[noreply] [BEAM-14157] Don't call requestObserver.onNext on a closed windmill

[noreply] Minor: Make IOTypeHints a real NamedTuple (#17174)

[noreply] [BEAM-14172] Update tox.ini for pydocs (#17176)

[noreply] [BEAM-14065] Upgrade vendored bytebuddy to version 1.12.8 (#17028)


------------------------------------------
[...truncated 24.98 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648198777343496615/****\022@9990ddb428b105c428973d4b273df6cef4e95070f26a13c8c96360d918367eee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/25 08:59:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648198777343496615/model
2022/03/25 08:59:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0325065655"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648198777343496615/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648198777343496615/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0325065655",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/25 08:59:38 Submitted job: 2022-03-25_01_59_38-16297583681998196202
2022/03/25 08:59:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-25_01_59_38-16297583681998196202?project=apache-beam-testing
2022/03/25 08:59:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-25_01_59_38-16297583681998196202
2022/03/25 08:59:38 Job state: JOB_STATE_PENDING ...
2022/03/25 09:00:08 Job still running ...
2022/03/25 09:00:39 Job still running ...
2022/03/25 09:01:09 Job still running ...
2022/03/25 09:01:39 Job still running ...
2022/03/25 09:02:09 Job still running ...
2022/03/25 09:02:39 Job still running ...
2022/03/25 09:03:09 Job still running ...
2022/03/25 09:03:39 Job still running ...
2022/03/25 09:04:09 Job still running ...
2022/03/25 09:04:39 Job still running ...
2022/03/25 09:05:09 Failed to execute job: job 2022-03-25_01_59_38-16297583681998196202 failed
panic: Failed to execute job: job 2022-03-25_01_59_38-16297583681998196202 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc0000480c0, 0x103ea75, 0x19, 0xc000347df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 44s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/g736eop4ouvie

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #458

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/458/display/redirect?page=changes>

Changes:

[bulat.safiullin] [BEAM-13976] [Website] update homepage

[bulat.safiullin] [BEAM-13976] [Website] update homepage, add logo

[bulat.safiullin] [BEAM-13976] [Website] update text

[bulat.safiullin] [BEAM-13976] [Website] Update Community landing page

[bulat.safiullin] [BEAM-13979] [Website] Update Community/Contact us page

[bulat.safiullin] [BEAM-13979] [Website] update title

[bulat.safiullin] [BEAM-13979] [Website] delete space

[bulat.safiullin] [BEAM-13979] [Website] add Beam Playground

[bulat.safiullin] [BEAM-13976] [Website] delete Beam Playground

[bulat.safiullin] [BEAM-13976] [Website] change navbar css links rules, delete links from

[bulat.safiullin] [BEAM-13977] [Website] delete available-contact-channels on mobile

[bulat.safiullin] [BEAM-13976] [Website] change padding size between the sections

[bulat.safiullin] [BEAM-13976] [Website] change title to capital letters

[bulat.safiullin] [BEAM-13976] [Website] change title

[bulat.safiullin] [BEAM-14040] [Website] create new page, add link

[bulat.safiullin] [BEAM-13977] [Website] change title

[bulat.safiullin] [BEAM-13979] [Website] change text

[bulat.safiullin] [BEAM-13976] [Website] change text

[bulat.safiullin] [BEAM-13977] [Website] change text, add capital letters

[bulat.safiullin] [BEAM-13976] [Website] add playground sass, change text-align

[bulat.safiullin] [BEAM-14040] [Website] add io connectors table

[bulat.safiullin] [BEAM-13976] [Website] add playground section, add empty line

[bulat.safiullin] [BEAM-14040] [Website] add overflow to css, add table content

[bulat.safiullin] [BEAM-14040] [Website] change ✘ for ✔, add license, add br

[bulat.safiullin] [BEAM-14040] [Website] add empty line

[bulat.safiullin] [BEAM-14040] [Website] change td

[bulat.safiullin] [BEAM-14041] [Website] update built io transforms

[bulat.safiullin] [BEAM-14041] [Website] move connectors from Miscellaneous to Database

[bulat.safiullin] [BEAM-14040] [Website] change links color

[danielamartinmtz] Updated metrics' CronJob API to use the latest batch version.

[bulat.safiullin] [BEAM-14041] [Website] change IO from go to java

[bulat.safiullin] [BEAM-14040] [Website] change links, change specific version to current

[danielamartinmtz] Updated cluster to test in metrics-upgrade-clone in BeamMetrics_Publish

[aydar.zaynutdinov] [BEAM-13976][Website]

[aydar.zaynutdinov] [BEAM-14040][Website]

[aydar.zaynutdinov] [BEAM-14041][Website]

[danielamartinmtz] Updated StateFulSet k8s obejct in cassandra-svc-statefulset.yaml file in

[danielamartinmtz] Updated documentation including cluster specs.

[noreply] Beam 13058 k8s apis upgrade - elasticsearch (#18)

[danielamartinmtz] Removed code used for testing.

[danielamartinmtz] Removed code used for testing in job_PostCommit_BeamMetrics_Publish

[noreply] Beam 13058 k8s apis upgrade - Adding Basic Auth details in documentation

[mmack] [BEAM-13232] Close clients properly in KinesisSource. Also use lazy init

[Pablo Estrada] [BEAM-14151] Excluding Spanner CDC tests from Dataflow V1 suite

[danielamartinmtz] Added comments in initContainers and remove unused code in elasticsearch

[noreply] [BEAM-14134] Optimize memory allocations for various core coders

[noreply] [BEAM-14129] Restructure PubsubLiteIO Read side to produce smaller

[noreply] [BEAM-12697] Add primitive field generation from IR to SBE extension

[noreply] [BEAM-13889] Add test cases to jsonx package (#17124)

[noreply] Remove unreachable code in container.go (#17166)

[noreply] Add ability to handle streaming input to AvroSchemaIOProvider (#17126)

[noreply] [BEAM-12898] Flink Load Tests failure- UncheckedExecutionException -

[Daniel Oliveira] Moving to 2.39.0-SNAPSHOT on master branch.


------------------------------------------
[...truncated 24.89 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648112376523881535/****\022@9990ddb428b105c428973d4b273df6cef4e95070f26a13c8c96360d918367eee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/24 08:59:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648112376523881535/model
2022/03/24 08:59:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0324070455"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648112376523881535/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648112376523881535/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0324070455",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/24 08:59:37 Submitted job: 2022-03-24_01_59_37-10993425597646892666
2022/03/24 08:59:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-24_01_59_37-10993425597646892666?project=apache-beam-testing
2022/03/24 08:59:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-24_01_59_37-10993425597646892666
2022/03/24 08:59:37 Job state: JOB_STATE_PENDING ...
2022/03/24 09:00:07 Job still running ...
2022/03/24 09:00:37 Job still running ...
2022/03/24 09:01:07 Job still running ...
2022/03/24 09:01:37 Job still running ...
2022/03/24 09:02:08 Job still running ...
2022/03/24 09:02:38 Job still running ...
2022/03/24 09:03:08 Failed to execute job: job 2022-03-24_01_59_37-10993425597646892666 failed
panic: Failed to execute job: job 2022-03-24_01_59_37-10993425597646892666 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc000120000, 0x103ea75, 0x19, 0xc000441df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 42s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lobp266q2ra5m

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #457

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/457/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14141] Set Interactive Beam to use the default Dataproc image

[noreply] BEAM-14115 - Update find criteria limited to _id (#17102)

[chamikaramj] Disable BigQueryIOStorageWriteIT for general Java post-commit

[noreply] Revert "[BEAM-14038] Auto-startup for Python expansion service.

[noreply] Minor: Bump timeout for Java PreCommit (#17157)

[noreply] [BEAM-14152] Disable flaky

[noreply] Fixing a small bug in TypedSchemaTransformTest that caused it to flake.

[noreply] [BEAM-14116] Catch MonitoringInfoMetricName null keys or values in the

[noreply] [BEAM-14129] Restructure SubscriptionPartitionLoader to use a manual SDF

[noreply] [BEAM-13015] Avoid repeated weighing of StateKey in

[noreply] Add option to add modules to JDK add-open (#17110)

[noreply] [BEAM-13015] Clarify ownership of the list for state caching across


------------------------------------------
[...truncated 25.02 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648026107687840028/****\022@89bdd81c907caa43a97ae4ce7032c4c8ee1e252c8e382242e8f202a3c6d8d503"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/23 09:01:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648026107687840028/model
2022/03/23 09:01:48 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0323065938"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648026107687840028/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648026107687840028/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0323065938",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/23 09:01:49 Submitted job: 2022-03-23_02_01_48-11529533805586335474
2022/03/23 09:01:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-23_02_01_48-11529533805586335474?project=apache-beam-testing
2022/03/23 09:01:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-23_02_01_48-11529533805586335474
2022/03/23 09:01:49 Job state: JOB_STATE_PENDING ...
2022/03/23 09:02:19 Job still running ...
2022/03/23 09:02:49 Job still running ...
2022/03/23 09:03:19 Job still running ...
2022/03/23 09:03:49 Job still running ...
2022/03/23 09:04:19 Job still running ...
2022/03/23 09:04:49 Job still running ...
2022/03/23 09:05:19 Failed to execute job: job 2022-03-23_02_01_48-11529533805586335474 failed
panic: Failed to execute job: job 2022-03-23_02_01_48-11529533805586335474 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc0000480c0, 0x103ea75, 0x19, 0xc000631df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 6s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/o4kl24btcwbw2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #456

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/456/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-14124] Add display data to BQ storage reads.

[mmack] [adhoc] Move aws IT tests to testing package according to best practices

[noreply] fixes static checks and go lint issues (#17138)

[Kyle Weaver] Don't print in task configuration.

[noreply] [BEAM-14136] Clean up staticcheck and linter warnings in the Go SDK

[noreply] Merge pull request #17063 from [BEAM-12164] Fix flaky tests

[noreply] Revert "[BEAM-14112] Avoid storing a generator in _CustomBigQuerySource

[Kyle Weaver] [BEAM-4106] Remove filesToStage from Flink pipeline option list.

[noreply] [BEAM-14071] Enabling Flink on Dataproc for Interactive Beam (#17044)

[noreply] Minor: Bypass schema registry in schemas_test.py (#17108)


------------------------------------------
[...truncated 25.04 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647939594401507642/****\022@89bdd81c907caa43a97ae4ce7032c4c8ee1e252c8e382242e8f202a3c6d8d503"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/22 08:59:55 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647939594401507642/model
2022/03/22 08:59:55 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0322065642"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647939594401507642/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647939594401507642/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0322065642",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/22 08:59:55 Submitted job: 2022-03-22_01_59_55-17628866107421477488
2022/03/22 08:59:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-22_01_59_55-17628866107421477488?project=apache-beam-testing
2022/03/22 08:59:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-22_01_59_55-17628866107421477488
2022/03/22 08:59:55 Job state: JOB_STATE_PENDING ...
2022/03/22 09:00:25 Job still running ...
2022/03/22 09:00:55 Job still running ...
2022/03/22 09:01:25 Job still running ...
2022/03/22 09:01:55 Job still running ...
2022/03/22 09:02:25 Job still running ...
2022/03/22 09:02:55 Job still running ...
2022/03/22 09:03:25 Failed to execute job: job 2022-03-22_01_59_55-17628866107421477488 failed
panic: Failed to execute job: job 2022-03-22_01_59_55-17628866107421477488 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc000120000, 0x103ea75, 0x19, 0xc000353df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5a2utrkqkp46c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #455

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/455/display/redirect>

Changes:


------------------------------------------
[...truncated 24.98 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647853183583753758/****\022@c06482db454ca731530f75b090732fdf52183f7c27523a10819b066d327b36e6"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/21 08:59:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647853183583753758/model
2022/03/21 08:59:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0321065628"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647853183583753758/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647853183583753758/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0321065628",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/21 08:59:44 Submitted job: 2022-03-21_01_59_44-12489646049831838087
2022/03/21 08:59:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-21_01_59_44-12489646049831838087?project=apache-beam-testing
2022/03/21 08:59:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-21_01_59_44-12489646049831838087
2022/03/21 08:59:44 Job state: JOB_STATE_PENDING ...
2022/03/21 09:00:14 Job still running ...
2022/03/21 09:00:44 Job still running ...
2022/03/21 09:01:14 Job still running ...
2022/03/21 09:01:44 Job still running ...
2022/03/21 09:02:15 Job still running ...
2022/03/21 09:02:45 Failed to execute job: job 2022-03-21_01_59_44-12489646049831838087 failed
panic: Failed to execute job: job 2022-03-21_01_59_44-12489646049831838087 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc000128000, 0x103ea75, 0x19, 0xc0002c3df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/72cxy46zjlepa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #454

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/454/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14122] Upgrade pip-licenses dependency (#17132)


------------------------------------------
[...truncated 24.99 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647766788518264400/****\022@c06482db454ca731530f75b090732fdf52183f7c27523a10819b066d327b36e6"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/20 08:59:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647766788518264400/model
2022/03/20 08:59:49 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0320065634"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647766788518264400/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647766788518264400/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0320065634",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/20 08:59:49 Submitted job: 2022-03-20_01_59_49-15530751056926035911
2022/03/20 08:59:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-20_01_59_49-15530751056926035911?project=apache-beam-testing
2022/03/20 08:59:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-20_01_59_49-15530751056926035911
2022/03/20 08:59:49 Job state: JOB_STATE_PENDING ...
2022/03/20 09:00:19 Job still running ...
2022/03/20 09:00:49 Job still running ...
2022/03/20 09:01:20 Job still running ...
2022/03/20 09:01:50 Job still running ...
2022/03/20 09:02:20 Job still running ...
2022/03/20 09:02:50 Job still running ...
2022/03/20 09:03:20 Failed to execute job: job 2022-03-20_01_59_49-15530751056926035911 failed
panic: Failed to execute job: job 2022-03-20_01_59_49-15530751056926035911 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc0000480c0, 0x103ea75, 0x19, 0xc0003f9df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lqz62pwyvqyki

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #453

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/453/display/redirect?page=changes>

Changes:

[Kiley Sok] Add Java 17 Nexmark metrics to Grafana

[yiru] .

[yiru] .

[yiru] .

[yiru] format fix

[yiru] .

[yiru] make DoFn into a separate class

[yiru] .

[yiru] fix setting

[mmack] [adhoc] Minor cleanup for aws2 tests

[mmack] [BEAM-14125] Update website IO matrix to recommend aws2 IOs

[noreply] [BEAM-14128] Eliminating quadratic behavior of

[noreply] [BEAM-13972] Add RunInference interface (#16917)

[noreply] Merge pull request #17116 from [BEAM-12164] Remove change_stream in

[yiru] fix checkstyle

[yiru] spotlessapply

[noreply] Deprecate tags.go (#17025)

[noreply] [BEAM-12753] and [BEAM-12815] Fix Flink Integration Tests (#17067)

[noreply] Merge pull request #16895 from [BEAM-13882][Playground] More tests for

[noreply] [BEAM-13925] Add weekly automation to update our reviewer config

[noreply] Merge pull request #17076 from Beam 14082 update payground for mobile

[noreply] [BEAM-13925] Assign committers in the scheduled action (#17062)

[noreply] Pin setup-gcloud to v0 instead of master (#17123)

[noreply] [BEAM-3304] documentation for PaneInfo in BPG (#17047)

[noreply] Merge pull request #17016 from [BEAM-14049][Playground] Add new API

[noreply] Merge pull request #17077 from [BEAM-14078] [Website] change link

[noreply] Merge pull request #17085 from [BEAM-14077] [Website] add beam

[noreply] Update Changes.md w/Go pipeline pre-process fix.

[noreply] [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088)

[noreply] Merge pull request #17023 from [BEAM-12164]: Remove child partition


------------------------------------------
[...truncated 24.90 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647680377388646274/****\022@c06482db454ca731530f75b090732fdf52183f7c27523a10819b066d327b36e6"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/19 08:59:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647680377388646274/model
2022/03/19 08:59:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0319065724"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647680377388646274/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647680377388646274/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0319065724",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/19 08:59:38 Submitted job: 2022-03-19_01_59_38-5494691235604852244
2022/03/19 08:59:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-19_01_59_38-5494691235604852244?project=apache-beam-testing
2022/03/19 08:59:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-19_01_59_38-5494691235604852244
2022/03/19 08:59:38 Job state: JOB_STATE_PENDING ...
2022/03/19 09:00:08 Job still running ...
2022/03/19 09:00:38 Job still running ...
2022/03/19 09:01:08 Job still running ...
2022/03/19 09:01:38 Job still running ...
2022/03/19 09:02:08 Job still running ...
2022/03/19 09:02:38 Job still running ...
2022/03/19 09:03:09 Failed to execute job: job 2022-03-19_01_59_38-5494691235604852244 failed
panic: Failed to execute job: job 2022-03-19_01_59_38-5494691235604852244 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc000120000, 0x103ea75, 0x19, 0xc000441df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 43s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5e2vh36cqewii

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #452

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/452/display/redirect?page=changes>

Changes:

[Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage.

[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner

[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)

[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,

[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.

[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource (#17100)

[noreply] Populate environment capabilities in v1beta3 protos. (#17042)

[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in BQ IO.

[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on Dataflow,

[noreply] [BEAM-14038] Auto-startup for Python expansion service. (#17035)

[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.

[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)

[noreply] Merge pull request #16977 from [BEAM-12164]  Added integration test for


------------------------------------------
[...truncated 25.05 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647593985501784716/****\022@d8366167860eaccb00d17c52ce6cff8eed1a212ce2d3a74a5e1f92c2f1632bbc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/18 08:59:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647593985501784716/model
2022/03/18 08:59:46 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0318065649"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647593985501784716/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647593985501784716/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0318065649",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/18 08:59:46 Submitted job: 2022-03-18_01_59_46-10058773813786436572
2022/03/18 08:59:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-18_01_59_46-10058773813786436572?project=apache-beam-testing
2022/03/18 08:59:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-18_01_59_46-10058773813786436572
2022/03/18 08:59:46 Job state: JOB_STATE_PENDING ...
2022/03/18 09:00:16 Job still running ...
2022/03/18 09:00:46 Job still running ...
2022/03/18 09:01:16 Job still running ...
2022/03/18 09:01:46 Job still running ...
2022/03/18 09:02:16 Job still running ...
2022/03/18 09:02:46 Job still running ...
2022/03/18 09:03:16 Failed to execute job: job 2022-03-18_01_59_46-10058773813786436572 failed
panic: Failed to execute job: job 2022-03-18_01_59_46-10058773813786436572 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11517a8, 0xc0000480c0, 0x103ea75, 0x19, 0xc000675df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4enteeq7lawea

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #451

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/451/display/redirect?page=changes>

Changes:

[noreply] Mapped JOB_STATE_RESOURCE_CLEANING_UP to State.RUNNING.

[ryanthompson591] fixed typo in typehints

[zyichi] Remove unused prebuild_sdk_container_base_iamge option from validate

[hengfeng] feat: add more custom metrics

[noreply] [BEAM-14103][Playgrounf][Bugfix] Fix google analytics id (#17092)

[noreply] Minor: Make ScopedReadStateSupplier final (#16992)

[noreply] [BEAM-14113] Improve SamzaJobServerDriver extensibility (#17099)

[noreply] [BEAM-14116] Chunk commit requests dynamically (#17004)

[noreply] Merge pull request #17079 from [BEAM-13660] Add types and queries in

[noreply] [BEAM-13888] Add unit testing to ioutilx (#17058)

[noreply] Merge pull request #16822 from [BEAM-13841][Playground] Add Application

[noreply] Minor: Make serializableCoder warning gramatically correct english

[noreply] [BEAM-14091] Fixing Interactive Beam show/collect for remote runners


------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-4 (beam) in workspace <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
 > git init <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git --version # 'git version 2.25.1'
 > git fetch --tags --force --progress -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --tags --force --progress -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision d08cef67418b351db15b355b59785a37cda63fef (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f d08cef67418b351db15b355b59785a37cda63fef # timeout=10
Commit message: "Merge pull request #17055: [BEAM-14087] Mapped JOB_STATE_RESOURCE_CLEANING_UP to State.RUNNING"
 > git rev-list --no-walk fc442c1bebdb4645266c96d777b82a311d18a489 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1
SETUPTOOLS_USE_DISTUTILS=stdlib

[EnvInject] - Variables injected successfully.
[beam_LoadTests_Go_CoGBK_Dataflow_batch] $ /bin/bash -xe /tmp/jenkins8123160115790524828.sh
+ echo '*** CoGroupByKey Go Load test: 2GB of 100B records with a single key ***'
*** CoGroupByKey Go Load test: 2GB of 100B records with a single key ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/gradlew> -PloadTest.mainClass=cogbk -Prunner=DataflowRunner '-PloadTest.args=--job_name=load-tests-go-dataflow-batch-cogbk-1-0317065645 --project=apache-beam-testing --region=us-central1 --temp_location=gs://temp-storage-for-perf-tests/loadtests --staging_location=gs://temp-storage-for-perf-tests/loadtests --influx_measurement=go_batch_cogbk_1 --influx_namespace=dataflow --input_options='{"num_records": 20000000,"key_size": 10,"value_size": 90,"num_hot_keys": 1,"hot_key_fraction": 1}' --co_input_options='{"num_records": 2000000,"key_size": 10,"value_size": 90,"num_hot_keys": 1000,"hot_key_fraction": 1}' --iterations=1 --num_****s=5 --autoscaling_algorithm=NONE --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --runner=DataflowRunner' --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses :sdks:go:test:load:run
Starting a Gradle Daemon, 1 busy and 1 stopped Daemons could not be reused, use --status for details
Configuration on demand is an incubating feature.
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :buildSrc:assemble
> Task :buildSrc:spotlessGroovy
> Task :buildSrc:spotlessGroovy FAILED
> Task :buildSrc:spotlessGroovyGradle FROM-CACHE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins FROM-CACHE

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':buildSrc:spotlessGroovy'.
> Failed to load cache entry for task ':buildSrc:spotlessGroovy'

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 1m 44s
9 actionable tasks: 5 executed, 3 from cache, 1 up-to-date

Publishing build scan...
https://gradle.com/s/hoorbwtm7t2yu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #450

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/450/display/redirect?page=changes>

Changes:

[Chamikara Madhusanka Jayalath] Updates x-lang release validation to use staged jars

[dhuntsperger] documented maven-to-gradle conversion for Dataflow; refactored java

[dhuntsperger] adding a list of example pipelines

[dhuntsperger] removing unnecessary `ls` command from maven project generation

[mmack] [BEAM-13175] Add KinesisIO.write for AWS SDK v2.

[dhuntsperger] fixing filename formatting in response to feedback

[dhuntsperger] adding extra step emphasizing runner setupt

[dhuntsperger] reorganized instructions to emphasize setup steps for runners

[mmack] [BEAM-13175] Document changes to IOs in amazon-web-services2 for AWS

[noreply] [BEAM-13767] Move a bunch of python tasks to use gradle configuration…

[noreply] Merge pull request #17052 from [BEAM-13818] [SnowflakeIO] Add support

[noreply] Adding pydoc for StateHandler (#17091)

[noreply] BEAM-3165 Bypass split if numSplit is zero (#17084)


------------------------------------------
[...truncated 25.11 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647421279771729360/****\022@5bd6da88c3a49da38bf70d7845362e43f05d24edfcb361bac6e696e3bc9633ee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/16 09:01:20 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647421279771729360/model
2022/03/16 09:01:20 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0316065633"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647421279771729360/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647421279771729360/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0316065633",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/16 09:01:21 Submitted job: 2022-03-16_02_01_20-10050758906766400690
2022/03/16 09:01:21 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-16_02_01_20-10050758906766400690?project=apache-beam-testing
2022/03/16 09:01:21 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-16_02_01_20-10050758906766400690
2022/03/16 09:01:21 Job state: JOB_STATE_PENDING ...
2022/03/16 09:01:51 Job still running ...
2022/03/16 09:02:21 Job still running ...
2022/03/16 09:02:51 Job still running ...
2022/03/16 09:03:21 Job still running ...
2022/03/16 09:03:51 Job still running ...
2022/03/16 09:04:21 Job still running ...
2022/03/16 09:04:51 Job still running ...
2022/03/16 09:05:21 Job still running ...
2022/03/16 09:05:51 Job still running ...
2022/03/16 09:06:21 Job still running ...
2022/03/16 09:06:51 Failed to execute job: job 2022-03-16_02_01_20-10050758906766400690 failed
panic: Failed to execute job: job 2022-03-16_02_01_20-10050758906766400690 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11516c8, 0xc0000480c0, 0x103e995, 0x19, 0xc000449df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7lbymuxvbf6mm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #449

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/449/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test

[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test

[benjamin.gonzalez] [BEAM-12572] Add java examples tests

[benjamin.gonzalez] [BEAM-12572] Change tests collected by runner

[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions, skip tests for specific runners

[benjamin.gonzalez] [BEAM-12572] Skip failing tests

[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warnings

[benjamin.gonzalez] [BEAM-12572] Skip tfidf tests on direct runner

[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions

[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warning

[benjamin.gonzalez] [BEAM-12572] Enable test with Pipeline serialization error fixed, link

[benjamin.gonzalez] [BEAM-12572] Sickbay TfIdf test for DirectRunner

[benjamin.gonzalez] [BEAM-12572] Refactor naming for BigQueryClient

[mmack] [adhoc] Update owners for aws modules

[noreply] [BEAM-14051] Add a warning to gradle.properties that many Beam modules

[noreply] Merge pull request #17000 from [BEAM-13881] [Playground] Increase test

[noreply] Add deterministic dict coding via key sorting. (#17037)

[noreply] Merge pull request #17054 from [BEAM-14075] [SnowflakeIO] Change a


------------------------------------------
[...truncated 25.03 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647334788097832761/****\022@5bd6da88c3a49da38bf70d7845362e43f05d24edfcb361bac6e696e3bc9633ee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/15 08:59:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647334788097832761/model
2022/03/15 08:59:48 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0315065628"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647334788097832761/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647334788097832761/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0315065628",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/15 08:59:49 Submitted job: 2022-03-15_01_59_48-12883399526919636608
2022/03/15 08:59:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-15_01_59_48-12883399526919636608?project=apache-beam-testing
2022/03/15 08:59:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-15_01_59_48-12883399526919636608
2022/03/15 08:59:49 Job state: JOB_STATE_PENDING ...
2022/03/15 09:00:20 Job still running ...
2022/03/15 09:00:50 Job still running ...
2022/03/15 09:01:20 Job still running ...
2022/03/15 09:01:50 Job still running ...
2022/03/15 09:02:20 Job still running ...
2022/03/15 09:02:50 Job still running ...
2022/03/15 09:03:20 Failed to execute job: job 2022-03-15_01_59_48-12883399526919636608 failed
panic: Failed to execute job: job 2022-03-15_01_59_48-12883399526919636608 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11516c8, 0xc00019a000, 0x103e995, 0x19, 0xc0003ebdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/kebcv3eccmbvu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #448

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/448/display/redirect>

Changes:


------------------------------------------
[...truncated 25.03 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647248391261539053/****\022@5bd6da88c3a49da38bf70d7845362e43f05d24edfcb361bac6e696e3bc9633ee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/14 08:59:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647248391261539053/model
2022/03/14 08:59:51 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0314065642"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647248391261539053/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647248391261539053/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0314065642",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/14 08:59:52 Submitted job: 2022-03-14_01_59_51-11921365149192168510
2022/03/14 08:59:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-14_01_59_51-11921365149192168510?project=apache-beam-testing
2022/03/14 08:59:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-14_01_59_51-11921365149192168510
2022/03/14 08:59:52 Job state: JOB_STATE_PENDING ...
2022/03/14 09:00:22 Job still running ...
2022/03/14 09:00:52 Job still running ...
2022/03/14 09:01:22 Job still running ...
2022/03/14 09:01:52 Job still running ...
2022/03/14 09:02:22 Job still running ...
2022/03/14 09:02:52 Job still running ...
2022/03/14 09:03:22 Failed to execute job: job 2022-03-14_01_59_51-11921365149192168510 failed
panic: Failed to execute job: job 2022-03-14_01_59_51-11921365149192168510 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11516c8, 0xc0000480c0, 0x103e995, 0x19, 0xc00065ddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 58s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/q3v3neveqadha

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #447

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/447/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14072] [BEAM-13993] [BEAM-10039] Import beam plugins before


------------------------------------------
[...truncated 25.03 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647162003080185453/****\022@5bd6da88c3a49da38bf70d7845362e43f05d24edfcb361bac6e696e3bc9633ee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e4"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/13 09:00:03 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647162003080185453/model
2022/03/13 09:00:03 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0313065618"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647162003080185453/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647162003080185453/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0313065618",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/13 09:00:04 Submitted job: 2022-03-13_01_00_03-17809918284720902725
2022/03/13 09:00:04 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-13_01_00_03-17809918284720902725?project=apache-beam-testing
2022/03/13 09:00:04 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-13_01_00_03-17809918284720902725
2022/03/13 09:00:04 Job state: JOB_STATE_PENDING ...
2022/03/13 09:00:34 Job still running ...
2022/03/13 09:01:04 Job still running ...
2022/03/13 09:01:34 Job still running ...
2022/03/13 09:02:04 Job still running ...
2022/03/13 09:02:34 Job still running ...
2022/03/13 09:03:04 Job still running ...
2022/03/13 09:03:34 Failed to execute job: job 2022-03-13_01_00_03-17809918284720902725 failed
panic: Failed to execute job: job 2022-03-13_01_00_03-17809918284720902725 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11516c8, 0xc0000480c0, 0x103e995, 0x19, 0xc0005e9df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 7s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/sm2y4lwd2kddo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #446

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/446/display/redirect?page=changes>

Changes:

[Ismaël Mejía] [BEAM-13981] Remove Spark Runner specific code for event logging

[vitaly.terentyev] [BEAM-2766] Support null key/values in HadoopFormatIO

[vitaly.terentyev] [BEAM-2766] Fix checkstyle


------------------------------------------
[...truncated 25.08 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647075589344199650/****\022@5bd6da88c3a49da38bf70d7845362e43f05d24edfcb361bac6e696e3bc9633ee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e4"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/12 08:59:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647075589344199650/model
2022/03/12 08:59:50 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0312065633"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647075589344199650/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647075589344199650/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0312065633",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/12 08:59:50 Submitted job: 2022-03-12_00_59_50-2843519302782477643
2022/03/12 08:59:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-12_00_59_50-2843519302782477643?project=apache-beam-testing
2022/03/12 08:59:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-12_00_59_50-2843519302782477643
2022/03/12 08:59:50 Job state: JOB_STATE_PENDING ...
2022/03/12 09:00:20 Job still running ...
2022/03/12 09:00:50 Job still running ...
2022/03/12 09:01:20 Job still running ...
2022/03/12 09:01:50 Job still running ...
2022/03/12 09:02:21 Job still running ...
2022/03/12 09:02:51 Job still running ...
2022/03/12 09:03:21 Job still running ...
2022/03/12 09:03:51 Job still running ...
2022/03/12 09:04:21 Job still running ...
2022/03/12 09:04:51 Job still running ...
2022/03/12 09:05:21 Failed to execute job: job 2022-03-12_00_59_50-2843519302782477643 failed
panic: Failed to execute job: job 2022-03-12_00_59_50-2843519302782477643 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11516c8, 0xc0000480c0, 0x103e995, 0x19, 0xc0004e9df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/f7tkvkzvtwaey

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_CoGBK_Dataflow_batch #445

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/445/display/redirect?page=changes>

Changes:

[ihr] [BEAM-13923] Fix the answers placeholders locations in the Java katas

[jakub.kukul] [BEAM-14039] Propagate ignore_unknown_columns parameter.

[stranniknm] [BEAM-14079] playground - improve accessibility

[noreply] [BEAM-13925] Find and address prs that havent been reviewed in a week

[noreply] Fix import path

[noreply] [BEAM-13925] Fix one more import path

[noreply] Add a StatefulDoFn test that sets event time timer within allowed

[noreply] Merge pull request #17056 from [BEAM-14076] [SnowflakeIO] Add support


------------------------------------------
[...truncated 25.15 KB...]
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646989192437843287/****\022@5bd6da88c3a49da38bf70d7845362e43f05d24edfcb361bac6e696e3bc9633ee"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e8"
root_transform_ids: "e9_cogbk"
root_transform_ids: "e10"
root_transform_ids: "e11"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/11 08:59:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646989192437843287/model
2022/03/11 08:59:53 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-cogbk-1-0311065639"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/cogbk"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_cogbk_1"
        },
        {
          "key": "co_input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646989192437843287/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "co_input_options": "{\"num_records\": 2000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1000,\"hot_key_fraction\": 1}",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_cogbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 20000000,\"key_size\": 10,\"value_size\": 90,\"num_hot_keys\": 1,\"hot_key_fraction\": 1}",
          "iterations": "1",
          "****_binary": "linux_amd64/cogbk"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646989192437843287/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-cogbk-1-0311065639",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/11 08:59:53 Submitted job: 2022-03-11_00_59_53-12610151138755303915
2022/03/11 08:59:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-11_00_59_53-12610151138755303915?project=apache-beam-testing
2022/03/11 08:59:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-11_00_59_53-12610151138755303915
2022/03/11 08:59:53 Job state: JOB_STATE_PENDING ...
2022/03/11 09:00:23 Job still running ...
2022/03/11 09:00:53 Job still running ...
2022/03/11 09:01:23 Job still running ...
2022/03/11 09:01:53 Job still running ...
2022/03/11 09:02:24 Job still running ...
2022/03/11 09:02:54 Job still running ...
2022/03/11 09:03:24 Job still running ...
2022/03/11 09:03:54 Job still running ...
2022/03/11 09:04:24 Job still running ...
2022/03/11 09:04:54 Job still running ...
2022/03/11 09:05:24 Job still running ...
2022/03/11 09:05:54 Failed to execute job: job 2022-03-11_00_59_53-12610151138755303915 failed
panic: Failed to execute job: job 2022-03-11_00_59_53-12610151138755303915 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11516c8, 0xc0000480c0, 0x103e995, 0x19, 0xc0002e1df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/cogbk/cogbk.go>:99 +0x52a

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_CoGBK_Dataflow_batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 28s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/kzxpns5uznfna

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org