You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/03/10 10:18:14 UTC

Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #445

See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/445/display/redirect?page=changes>

Changes:

[hengfeng] [BEAM-12164]: display the metadata table's name on UI

[noreply] Revert "[BEAM-13993] [BEAM-10039] Import beam plugins before starting

[noreply] Merge pull request #17036 from [BEAM-12164] Convert all static instances

[noreply] fix variable reference (#16991)

[noreply] Merge pull request #16844 from [BEAM-12164]: allow for nanosecond

[noreply] [BEAM-13904] Increase unit testing in the reflectx package (#17024)


------------------------------------------
[...truncated 17.43 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646907280549481033/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/10 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646907280549481033/model
2022/03/10 10:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0308201252"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646907280549481033/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646907280549481033/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0308201252",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/10 10:14:41 Submitted job: 2022-03-10_02_14_41-7256181793274303501
2022/03/10 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-10_02_14_41-7256181793274303501?project=apache-beam-testing
2022/03/10 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-10_02_14_41-7256181793274303501
2022/03/10 10:14:41 Job state: JOB_STATE_PENDING ...
2022/03/10 10:15:11 Job still running ...
2022/03/10 10:15:41 Job still running ...
2022/03/10 10:16:11 Job still running ...
2022/03/10 10:16:42 Job still running ...
2022/03/10 10:17:12 Job still running ...
2022/03/10 10:17:42 Job still running ...
2022/03/10 10:18:12 Failed to execute job: job 2022-03-10_02_14_41-7256181793274303501 failed
panic: Failed to execute job: job 2022-03-10_02_14_41-7256181793274303501 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc000120000, 0x103e889, 0x19, 0xc0003ffe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mvtnx624dkmzq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_LoadTests_Go_GBK_Dataflow_Batch #503

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/503/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #502

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/502/display/redirect?page=changes>

Changes:

[zyichi] Move master readme.md to 2.40.0

[noreply] [BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink


------------------------------------------
[...truncated 17.87 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/****\022@d5e3302be53953788970a45089f4c84e179c393666cc6a221e16c83b8609a7ea"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 17:06:00 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/model
2022/05/05 17:06:00 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0505150310"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.40.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.40.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770359940525884/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.40.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0505150310",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/05 17:06:01 Submitted job: 2022-05-05_10_06_00-5280983618146128895
2022/05/05 17:06:01 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_10_06_00-5280983618146128895?project=apache-beam-testing
2022/05/05 17:06:01 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_10_06_00-5280983618146128895
2022/05/05 17:06:01 Job state: JOB_STATE_PENDING ...
2022/05/05 17:06:31 Job still running ...
2022/05/05 17:07:01 Job still running ...
2022/05/05 17:07:31 Job still running ...
2022/05/05 17:08:01 Job still running ...
2022/05/05 17:08:31 Job still running ...
2022/05/05 17:09:01 Job still running ...
2022/05/05 17:09:31 Job still running ...
2022/05/05 17:10:01 Job still running ...
2022/05/05 17:10:31 Job still running ...
2022/05/05 17:11:01 Failed to execute job: job 2022-05-05_10_06_00-5280983618146128895 failed
panic: Failed to execute job: job 2022-05-05_10_06_00-5280983618146128895 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231ac8, 0xc000120000, 0x110e7c4, 0x19, 0xc000445e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7dzf33qxlt6um

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #501

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/501/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-9245] Unable to pull datatore Entity which contains dict

[bulat.safiullin] [BEAM-14382] [Website] add banner container for with css, images, html

[Jan Lukavský] [BEAM-14196] add test verifying output watermark propagation in bundle

[Jan Lukavský] [BEAM-14196] Fix FlinkRunner mid-bundle output watermark handling

[nielm] [BEAM-14405] Fix NPE when ProjectID is not specified in a template

[bulat.safiullin] [BEAM-14382] change mobile banner img, add padding to banner section

[ahmedabualsaud] fix test decotrator typo

[noreply] Merge pull request #17440 from [BEAM-14329] Enable exponential backoff

[noreply] [BEAM-11104] Fix output forwarding issue for ProcessContinuations

[noreply] re-add testing package to pydoc (#17524)

[Heejong Lee] add test

[noreply] [BEAM-14250] Amended the workaround (#17531)

[noreply] [BEAM-11104] Fix broken split result validation (#17546)

[noreply] Fixed a SQL and screenshots in the Beam SQL blog (#17545)

[noreply] Merge pull request #17417: [BEAM-14388] Address some performance

[noreply] [BEAM-14386] [Flink] Support for scala 2.12 (#17512)

[noreply] [BEAM-14294] Worker changes to support trivial Batched DoFns (#17384)

[zyichi] Moving to 2.40.0-SNAPSHOT on master branch.

[noreply] [BEAM-14048] [CdapIO] Add ConfigWrapper for building CDAP PluginConfigs


------------------------------------------
[...truncated 17.66 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/****\022@69432aee790707f01f5db56364a6c14676b5f0a8d05487850b8dad0ff4e3e4ce"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/model
2022/05/05 10:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0505100250"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.40.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.40.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651745682185912279/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.40.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0505100250",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/05 10:14:43 Submitted job: 2022-05-05_03_14_43-4748960088116013041
2022/05/05 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_03_14_43-4748960088116013041?project=apache-beam-testing
2022/05/05 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_03_14_43-4748960088116013041
2022/05/05 10:14:43 Job state: JOB_STATE_PENDING ...
2022/05/05 10:15:13 Job still running ...
2022/05/05 10:15:43 Job still running ...
2022/05/05 10:16:13 Job still running ...
2022/05/05 10:16:43 Job still running ...
2022/05/05 10:17:13 Job still running ...
2022/05/05 10:17:43 Failed to execute job: job 2022-05-05_03_14_43-4748960088116013041 failed
panic: Failed to execute job: job 2022-05-05_03_14_43-4748960088116013041 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231a68, 0xc000120000, 0x110e764, 0x19, 0xc00040fe78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/am77tcufz7a4e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #500

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/500/display/redirect?page=changes>

Changes:

[noreply] fix: JDBC config schema fields order

[Brian Hulette] Revert "Merge pull request #17255 from kileys/test-revert"

[Brian Hulette] BEAM-14231: bypass schema cache for

[noreply] [BEAM-13657] Follow up update version warning in __init__ (#17493)

[noreply] Merge pull request #17431 from [BEAM-14273] Add integration tests for BQ

[noreply] Merge pull request #17205 from [BEAM-14145] [Website] add carousel to

[noreply] [BEAM-14064] fix es io windowing (#17112)

[noreply] [BEAM-13670] Upgraded ipython from v7 to v8 (#17529)

[noreply] [BEAM-11104] Enable ProcessContinuation return values, add unit test

[Robert Bradshaw] [BEAM-14403] Allow Prime to be used with legacy workers.

[noreply] [BEAM-11106] Support drain in Go SDK (#17432)

[noreply] add __Init__ to inference. (#17514)


------------------------------------------
[...truncated 17.64 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/****\022@d766422b0dc71d2a087cb20896017c6b19fac3763be4352964a8ac35fbeaf558"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/04 10:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/model
2022/05/04 10:14:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651659279750722512/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/04 10:14:41 Submitted job: 2022-05-04_03_14_40-10883133014636012091
2022/05/04 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-04_03_14_40-10883133014636012091?project=apache-beam-testing
2022/05/04 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-04_03_14_40-10883133014636012091
2022/05/04 10:14:41 Job state: JOB_STATE_PENDING ...
2022/05/04 10:15:11 Job still running ...
2022/05/04 10:15:41 Job still running ...
2022/05/04 10:16:11 Job still running ...
2022/05/04 10:16:41 Job still running ...
2022/05/04 10:17:11 Job still running ...
2022/05/04 10:17:41 Job still running ...
2022/05/04 10:18:11 Job still running ...
2022/05/04 10:18:41 Job still running ...
2022/05/04 10:19:11 Job still running ...
2022/05/04 10:19:42 Failed to execute job: job 2022-05-04_03_14_40-10883133014636012091 failed
panic: Failed to execute job: job 2022-05-04_03_14_40-10883133014636012091 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231a68, 0xc000120000, 0x110e764, 0x19, 0xc00087fe78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/nojhwy2wmgvce

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #499

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/499/display/redirect?page=changes>

Changes:

[yathu] [BEAM-14375] Fix Java Wordcount Dataflow postcommit

[Robert Bradshaw] Allow arithmetic between deferred scalars.

[noreply] [BEAM-14390] Set user-agent when pulling licenses to avoid 403s (#17521)

[noreply] [BEAM-8688] Upgrade GCSIO to 2.2.6 (#17486)

[noreply] [BEAM-14253] patch SubscriptionPartitionLoader to work around a dataflow

[noreply] Add website link log to notify user of pre-build workflow. (#17498)

[noreply] [BEAM-11105] Add timestamp observing watermark estimation (#17476)

[noreply] Merge pull request #17487 from Adding user-agent to GCS client in Python

[noreply] [BEAM-10265] Display error message if trying to infer recursive schema

[noreply] [BEAM-12575] Upgraded ipykernel from v5 to v6 (#17526)

[noreply] [BEAM-11105] Add docs + CHANGES.md entry for Go Watermark Estimation

[noreply] Merge pull request #17380 from [BEAM-14314][BEAM-9532] Add last_updated


------------------------------------------
[...truncated 17.71 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/****\022@d3274d4a0ed4ad37465faa13319515ddde5ba80f38ba7bf56e0bf6ca45f03ffb"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/03 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/model
2022/05/03 10:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651572878913216548/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/03 10:14:40 Submitted job: 2022-05-03_03_14_39-5735440478104037852
2022/05/03 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-03_03_14_39-5735440478104037852?project=apache-beam-testing
2022/05/03 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-03_03_14_39-5735440478104037852
2022/05/03 10:14:40 Job state: JOB_STATE_PENDING ...
2022/05/03 10:15:10 Job still running ...
2022/05/03 10:15:40 Job still running ...
2022/05/03 10:16:10 Job still running ...
2022/05/03 10:16:40 Job still running ...
2022/05/03 10:17:10 Job still running ...
2022/05/03 10:17:40 Job still running ...
2022/05/03 10:18:10 Job still running ...
2022/05/03 10:18:40 Job still running ...
2022/05/03 10:19:10 Job still running ...
2022/05/03 10:19:40 Failed to execute job: job 2022-05-03_03_14_39-5735440478104037852 failed
panic: Failed to execute job: job 2022-05-03_03_14_39-5735440478104037852 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x122e048, 0xc0000480c0, 0x110b251, 0x19, 0xc00033fe78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5wmhztp64b2ta

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #498

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/498/display/redirect?page=changes>

Changes:

[noreply] [BEAM-11105] Add manual watermark estimation (#17475)


------------------------------------------
[...truncated 17.57 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651486471958308263/****\022@8e1b4e734558eb3232ce336c1248294e83431eaa80a62b1107910de9ac24cdb2"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/02 10:14:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651486471958308263/model
2022/05/02 10:14:32 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651486471958308263/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651486471958308263/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/02 10:14:33 Submitted job: 2022-05-02_03_14_32-6512839335185940481
2022/05/02 10:14:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-02_03_14_32-6512839335185940481?project=apache-beam-testing
2022/05/02 10:14:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-02_03_14_32-6512839335185940481
2022/05/02 10:14:33 Job state: JOB_STATE_PENDING ...
2022/05/02 10:15:03 Job still running ...
2022/05/02 10:15:33 Job still running ...
2022/05/02 10:16:03 Job still running ...
2022/05/02 10:16:33 Job still running ...
2022/05/02 10:17:03 Job still running ...
2022/05/02 10:17:33 Job still running ...
2022/05/02 10:18:03 Job still running ...
2022/05/02 10:18:34 Job still running ...
2022/05/02 10:19:04 Job still running ...
2022/05/02 10:19:34 Failed to execute job: job 2022-05-02_03_14_32-6512839335185940481 failed
panic: Failed to execute job: job 2022-05-02_03_14_32-6512839335185940481 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120a8a8, 0xc0000480c0, 0x10e7eee, 0x19, 0xc0003ffe78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 12s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/a27yok7kxo44c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #497

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/497/display/redirect?page=changes>

Changes:

[noreply] Revert "Improvement to Seed job configuration to launch against PRs

[ilion.beyst] Minor: fix typo

[noreply] Merge pull request #17422 from [BEAM-14344]: remove tracing from


------------------------------------------
[...truncated 17.65 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651400069749517579/****\022@228c544e4b7d6d1e7d2921751bd6bdb52fb7d3c87d23de1f7e3d0486ac384666"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/01 10:14:30 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651400069749517579/model
2022/05/01 10:14:30 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651400069749517579/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651400069749517579/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/01 10:14:30 Submitted job: 2022-05-01_03_14_30-15038427463710332215
2022/05/01 10:14:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-01_03_14_30-15038427463710332215?project=apache-beam-testing
2022/05/01 10:14:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-01_03_14_30-15038427463710332215
2022/05/01 10:14:30 Job state: JOB_STATE_PENDING ...
2022/05/01 10:15:01 Job still running ...
2022/05/01 10:15:31 Job still running ...
2022/05/01 10:16:01 Job still running ...
2022/05/01 10:16:31 Job still running ...
2022/05/01 10:17:01 Job still running ...
2022/05/01 10:17:31 Job still running ...
2022/05/01 10:18:01 Job still running ...
2022/05/01 10:18:31 Job still running ...
2022/05/01 10:19:01 Job still running ...
2022/05/01 10:19:31 Failed to execute job: job 2022-05-01_03_14_30-15038427463710332215 failed
panic: Failed to execute job: job 2022-05-01_03_14_30-15038427463710332215 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209588, 0xc000120000, 0x10e6e1c, 0x19, 0xc0005c5e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 8s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/o44wcpmqsnroy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #496

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/496/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Add element weighting parameter to BatchElements.

[Robert Bradshaw] Clearer test.

[noreply] Revert "Merge pull request #17260 from [BEAM-13229] [Website] bug side

[noreply] [BEAM-14001] Add missing test cases to existing suites in exec package

[noreply] [BEAM-14243] Add staticcheck to Github Actions Precommits (#17479)

[noreply] [BEAM-14368][BEAM-13984]Change model loading from constructor to

[noreply] [BEAM-13983] changed file name from sklearn_loader to sklearn_inference

[noreply] Add SQL in Notebooks blog post (#17481)

[noreply] Merge pull request #17404: [BEAM-13990] support date and timestamp


------------------------------------------
[...truncated 17.61 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651313682584612348/****\022@228c544e4b7d6d1e7d2921751bd6bdb52fb7d3c87d23de1f7e3d0486ac384666"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/30 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651313682584612348/model
2022/04/30 10:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651313682584612348/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651313682584612348/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/30 10:14:43 Submitted job: 2022-04-30_03_14_43-865874495203774760
2022/04/30 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-30_03_14_43-865874495203774760?project=apache-beam-testing
2022/04/30 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-30_03_14_43-865874495203774760
2022/04/30 10:14:43 Job state: JOB_STATE_PENDING ...
2022/04/30 10:15:13 Job still running ...
2022/04/30 10:15:44 Job still running ...
2022/04/30 10:16:14 Job still running ...
2022/04/30 10:16:44 Job still running ...
2022/04/30 10:17:14 Job still running ...
2022/04/30 10:17:44 Failed to execute job: job 2022-04-30_03_14_43-865874495203774760 failed
panic: Failed to execute job: job 2022-04-30_03_14_43-865874495203774760 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209588, 0xc0000480c0, 0x10e6e1c, 0x19, 0xc00056be78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/k742amgc6u23k

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #495

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/495/display/redirect?page=changes>

Changes:

[ihr] Update Java katas to Beam 2.38

[noreply] [BEAM-14369] Fix "target/options: no such file or directory" error while

[noreply] [BEAM-14351] Inherit from Coder. (#17437)

[noreply] [BEAM-14297] Enable nullable key and value arrays for xlang kafka io

[noreply] Merge pull request #17444 from [BEAM-14310] [Website] bug home

[noreply] Merge pull request #17388 from [BEAM-14311] [Website] Home Page

[noreply] [BEAM-14376] Typo in method description doc

[noreply] Add default classpath when not present (#17491)

[thiagotnunes] fix: update javadocs for ChangeStreamMetrics

[noreply] Merge pull request #17443 from [BEAM-12164]: use the end timestamp for

[noreply] Merge pull request #17260 from [BEAM-13229] [Website] bug side nav

[noreply] [BEAM-14351] Fix the template and move the announcement to the next


------------------------------------------
[...truncated 17.65 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651227276943319292/****\022@228c544e4b7d6d1e7d2921751bd6bdb52fb7d3c87d23de1f7e3d0486ac384666"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/29 10:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651227276943319292/model
2022/04/29 10:14:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0428110920"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651227276943319292/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651227276943319292/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0428110920",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/29 10:14:38 Submitted job: 2022-04-29_03_14_37-18171854532606500240
2022/04/29 10:14:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-29_03_14_37-18171854532606500240?project=apache-beam-testing
2022/04/29 10:14:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-29_03_14_37-18171854532606500240
2022/04/29 10:14:38 Job state: JOB_STATE_PENDING ...
2022/04/29 10:15:08 Job still running ...
2022/04/29 10:15:38 Job still running ...
2022/04/29 10:16:08 Job still running ...
2022/04/29 10:16:38 Job still running ...
2022/04/29 10:17:08 Job still running ...
2022/04/29 10:17:38 Failed to execute job: job 2022-04-29_03_14_37-18171854532606500240 failed
panic: Failed to execute job: job 2022-04-29_03_14_37-18171854532606500240 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209588, 0xc000120000, 0x10e6e1c, 0x19, 0xc00044be78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 16s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dunbd4b3m4l72

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #494

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/494/display/redirect?page=changes>

Changes:

[nick.caballero] [BEAM-14363] Fixes WatermarkParameters builder for Kinesis

[noreply] [BEAM-11104] Add Checkpointing split to Go SDK (#17386)

[noreply] Merge pull request #17226 from [BEAM-14204] [Playground] Tests for

[noreply] [BEAM-13015, BEAM-14184] Address unbounded number of messages being

[noreply] Improvement to Seed job configuration to launch against PRs (#17468)

[noreply] [BEAM-13983] Small changes to sklearn runinference (#17459)

[chamikaramj] Renames ExternalPythonTransform to PythonExternalTransform


------------------------------------------
[...truncated 17.70 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651140879170173611/****\022@228c544e4b7d6d1e7d2921751bd6bdb52fb7d3c87d23de1f7e3d0486ac384666"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/28 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651140879170173611/model
2022/04/28 10:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0428000303"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651140879170173611/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651140879170173611/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0428000303",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/28 10:14:40 Submitted job: 2022-04-28_03_14_39-10004262055355952387
2022/04/28 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-28_03_14_39-10004262055355952387?project=apache-beam-testing
2022/04/28 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-28_03_14_39-10004262055355952387
2022/04/28 10:14:40 Job state: JOB_STATE_PENDING ...
2022/04/28 10:15:10 Job still running ...
2022/04/28 10:15:40 Job still running ...
2022/04/28 10:16:10 Job still running ...
2022/04/28 10:16:40 Job still running ...
2022/04/28 10:17:10 Job still running ...
2022/04/28 10:17:40 Job still running ...
2022/04/28 10:18:10 Job still running ...
2022/04/28 10:18:41 Job still running ...
2022/04/28 10:19:11 Job still running ...
2022/04/28 10:19:41 Failed to execute job: job 2022-04-28_03_14_39-10004262055355952387 failed
panic: Failed to execute job: job 2022-04-28_03_14_39-10004262055355952387 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209588, 0xc000120000, 0x10e6e1c, 0x19, 0xc0003ffe78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/q3bujxaby7vws

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #493

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/493/display/redirect?page=changes>

Changes:

[msbukal] FhirIO: use .search() or .searchType instead of .setResourceType()

[noreply] Remove unnecessary decorator from RunInference interface (#17463)

[noreply] [BEAM-13590] Minor deprecated warning fix (#17453)

[noreply] [BEAM-12164]: fix the negative throughput issue (#17461)

[noreply] Updated goldens for the screen diff integration tests (#17467)

[noreply] fixes copy by value error for bytes.Buffer in Error (#17469)

[noreply] Merge pull request #17354 from [BEAM-14170] - Create a test that runs

[noreply] Merge pull request #17447 from [BEAM-14357] Fix

[noreply] [BEAM-14324, BEAM-14325] Staticcheck cleanup in test files (#17393)

[noreply] BEAM-14187 Fix NPE (#17454)

[noreply] [BEAM-11105] Stateful watermark estimation (#17374)

[noreply] [BEAM-14304] implement parquetio to read/write parquet files (#17347)


------------------------------------------
[...truncated 17.67 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651054480905275410/****\022@1a8cbf0d1eec68004ef3d2259969cc9225c3ae810d67e5f51a826bd24e620942"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/27 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651054480905275410/model
2022/04/27 10:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0427100252"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651054480905275410/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651054480905275410/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0427100252",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/27 10:14:42 Submitted job: 2022-04-27_03_14_41-4546868229711315500
2022/04/27 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-27_03_14_41-4546868229711315500?project=apache-beam-testing
2022/04/27 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-27_03_14_41-4546868229711315500
2022/04/27 10:14:42 Job state: JOB_STATE_PENDING ...
2022/04/27 10:15:12 Job still running ...
2022/04/27 10:15:42 Job still running ...
2022/04/27 10:16:12 Job still running ...
2022/04/27 10:16:42 Job still running ...
2022/04/27 10:17:13 Job still running ...
2022/04/27 10:17:43 Job still running ...
2022/04/27 10:18:13 Job still running ...
2022/04/27 10:18:43 Job still running ...
2022/04/27 10:19:13 Job still running ...
2022/04/27 10:19:43 Failed to execute job: job 2022-04-27_03_14_41-4546868229711315500 failed
panic: Failed to execute job: job 2022-04-27_03_14_41-4546868229711315500 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208188, 0xc000120000, 0x10e5d1c, 0x19, 0xc0007d5e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/eub3wuizqtxzq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #492

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/492/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14343] Allow expansion service override in ExternalPythonTransform

[Heejong Lee] update

[Heejong Lee] allows remote host

[Heejong Lee] improve compatibility with python rowcoder

[ahmedabualsaud] added tempLocation to test pipeline options

[ahmedabualsaud] using tempRoot for temp bucket location

[ahmedabualsaud] small fixes

[noreply] [BEAM-14320] Update programming-guide w/Java GroupByKey example (#17369)

[noreply] Minor: Fix release script for `current` symlinks (#17457)

[noreply] Minor: fix typo (#17452)

[noreply] Change return type for PytorchInferenceRunner (#17460)

[noreply] [BEAM-13608] JmsIO dynamic topics feature (#17163)

[Heejong Lee] add test


------------------------------------------
[...truncated 17.38 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650968075452734331/****\022@d5227fb8580dab9ef4f7a9c2283df6593f46e843f8a6eb662cb5fda78b2283c1"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/26 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650968075452734331/model
2022/04/26 10:14:36 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0426100248"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650968075452734331/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650968075452734331/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0426100248",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/26 10:14:36 Submitted job: 2022-04-26_03_14_36-4488797451829970442
2022/04/26 10:14:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-26_03_14_36-4488797451829970442?project=apache-beam-testing
2022/04/26 10:14:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-26_03_14_36-4488797451829970442
2022/04/26 10:14:36 Job state: JOB_STATE_PENDING ...
2022/04/26 10:15:06 Job still running ...
2022/04/26 10:15:36 Job still running ...
2022/04/26 10:16:06 Job still running ...
2022/04/26 10:16:37 Job still running ...
2022/04/26 10:17:07 Job still running ...
2022/04/26 10:17:37 Job still running ...
2022/04/26 10:18:07 Job still running ...
2022/04/26 10:18:37 Job still running ...
2022/04/26 10:19:07 Job still running ...
2022/04/26 10:19:37 Failed to execute job: job 2022-04-26_03_14_36-4488797451829970442 failed
panic: Failed to execute job: job 2022-04-26_03_14_36-4488797451829970442 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f68, 0xc000120000, 0x10e17e5, 0x19, 0xc000631e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ltdbzuw7gaygu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #491

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/491/display/redirect>

Changes:


------------------------------------------
[...truncated 17.36 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650881676131203195/****\022@d5227fb8580dab9ef4f7a9c2283df6593f46e843f8a6eb662cb5fda78b2283c1"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/25 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650881676131203195/model
2022/04/25 10:14:36 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0425100237"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650881676131203195/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650881676131203195/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0425100237",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/25 10:14:37 Submitted job: 2022-04-25_03_14_36-14684707291423957406
2022/04/25 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-25_03_14_36-14684707291423957406?project=apache-beam-testing
2022/04/25 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-25_03_14_36-14684707291423957406
2022/04/25 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/25 10:15:07 Job still running ...
2022/04/25 10:15:37 Job still running ...
2022/04/25 10:16:07 Job still running ...
2022/04/25 10:16:37 Job still running ...
2022/04/25 10:17:07 Job still running ...
2022/04/25 10:17:37 Failed to execute job: job 2022-04-25_03_14_36-14684707291423957406 failed
panic: Failed to execute job: job 2022-04-25_03_14_36-14684707291423957406 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f68, 0xc000120000, 0x10e17e5, 0x19, 0xc00028de78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/x2p3eexvwt6le

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #490

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/490/display/redirect?page=changes>

Changes:

[noreply] [BEAM-13953] added documentation for BQ Storage Write API (#17391)


------------------------------------------
[...truncated 17.40 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650795276233105459/****\022@d5227fb8580dab9ef4f7a9c2283df6593f46e843f8a6eb662cb5fda78b2283c1"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/24 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650795276233105459/model
2022/04/24 10:14:36 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0424100238"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650795276233105459/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650795276233105459/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0424100238",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/24 10:14:37 Submitted job: 2022-04-24_03_14_36-5315818999145448678
2022/04/24 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-24_03_14_36-5315818999145448678?project=apache-beam-testing
2022/04/24 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-24_03_14_36-5315818999145448678
2022/04/24 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/24 10:15:07 Job still running ...
2022/04/24 10:15:37 Job still running ...
2022/04/24 10:16:07 Job still running ...
2022/04/24 10:16:37 Job still running ...
2022/04/24 10:17:07 Job still running ...
2022/04/24 10:17:37 Job still running ...
2022/04/24 10:18:07 Job still running ...
2022/04/24 10:18:37 Job still running ...
2022/04/24 10:19:07 Job still running ...
2022/04/24 10:19:38 Failed to execute job: job 2022-04-24_03_14_36-5315818999145448678 failed
panic: Failed to execute job: job 2022-04-24_03_14_36-5315818999145448678 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f68, 0xc000120000, 0x10e17e5, 0x19, 0xc000427e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/r36k2b3lcpfwi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #489

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/489/display/redirect?page=changes>

Changes:

[Andrew Pilloud] [BEAM-14321] SQL passes Null for Null aggregates

[noreply] Create apache-hop-with-dataflow.md

[noreply] Add files via upload

[noreply] Delete website/www/site/content/en/blog/apache-hop-with-dataflow

[noreply] Add files via upload

[Andrew Pilloud] [BEAM-14348] Upgrade to ZetaSQL 2022.04.1

[Andrew Pilloud] [BEAM-13735] Enable ZetaSQL tests for Java 17

[noreply] Update apache-hop-with-dataflow.md

[noreply] Update apache-hop-with-dataflow.md

[noreply] Update apache-hop-with-dataflow.md

[danielamartinmtz] Moved up get-credentials instruction for getting the kubeconfig file

[noreply] [BEAM-13657] Add python 3.6 update to CHANGES.md (#17435)

[noreply] Merge pull request #17438: [BEAM-8127] The GCP module to declare

[noreply] Merge pull request #17428: [BEAM-14326] Make sure BigQuery daemon thread

[noreply] [BEAM-14301] Add lint:ignore to noescape() func (#17355)

[noreply] [BEAM-14286] Remove unused vars in harness package (#17392)

[noreply] [BEAM-14327] Convert Results to QueryResults directly (#17398)

[noreply] [BEAM-14302] Simplify boolean check in fn.go (#17399)

[noreply] [BEAM-13983] Sklearn Loader for RunInference (#17368)

[noreply] Update authors.yml

[noreply] [BEAM-14358] add retry to connect to testcontainer (#17449)

[noreply] [BEAM-13106] Bump flink docs to 1.14 (#17430)


------------------------------------------
[...truncated 17.34 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650708880987327506/****\022@d5227fb8580dab9ef4f7a9c2283df6593f46e843f8a6eb662cb5fda78b2283c1"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/23 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650708880987327506/model
2022/04/23 10:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0423100247"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650708880987327506/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650708880987327506/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0423100247",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/23 10:14:42 Submitted job: 2022-04-23_03_14_41-13310528930982567675
2022/04/23 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-23_03_14_41-13310528930982567675?project=apache-beam-testing
2022/04/23 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-23_03_14_41-13310528930982567675
2022/04/23 10:14:42 Job state: JOB_STATE_PENDING ...
2022/04/23 10:15:12 Job still running ...
2022/04/23 10:15:42 Job still running ...
2022/04/23 10:16:12 Job still running ...
2022/04/23 10:16:42 Job still running ...
2022/04/23 10:17:12 Job still running ...
2022/04/23 10:17:43 Failed to execute job: job 2022-04-23_03_14_41-13310528930982567675 failed
panic: Failed to execute job: job 2022-04-23_03_14_41-13310528930982567675 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f68, 0xc000120000, 0x10e17e5, 0x19, 0xc000417e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/or2uf66prz7pg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #488

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/488/display/redirect?page=changes>

Changes:

[mmack] [BEAM-14335] Spotless Spark sources

[mmack] [BEAM-14345] Force paranamer 2.8 for Spark Hadoop version tests to avoid

[noreply] BEAM-13582 Fixing broken links in the documentation (#17300)

[kamil.bregula] Revert "[BEAM-14300] Fix Java precommit failure"

[kamil.bregula] Revert "Merge pull request #17223 from [BEAM-14215] Improve argument

[noreply] [BEAM-13657] Sunset python 3.6 (#17252)

[noreply] Removes unsupported Python 3.6 from the release validation script

[noreply] [BEAM-13984] Implement RunInference for PyTorch (#17196)

[noreply] [BEAM-13945] add json type support for java bigquery connector (#17209)

[noreply] [BEAM-14346] Fix incorrect error case index in ret2() (#17425)

[noreply] [BEAM-14342] Fix wrong default buffer type in fn_runner (#17420)

[noreply] Updates opencensus-api dependency to the latest version - 0.31.0

[noreply] [BEAM-14306] Add unit testing to pane coder (#17370)

[noreply] Updated the dep and golden for screen diff integration tests (#17442)


------------------------------------------
[...truncated 17.37 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650622481416444787/****\022@3a4cbf3600490040a5fec86a009479d6e8a1446c1bf27308ed57924bbe115df4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/22 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650622481416444787/model
2022/04/22 10:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0422100253"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650622481416444787/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650622481416444787/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0422100253",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/22 10:14:42 Submitted job: 2022-04-22_03_14_42-6805910100148431205
2022/04/22 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-22_03_14_42-6805910100148431205?project=apache-beam-testing
2022/04/22 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-22_03_14_42-6805910100148431205
2022/04/22 10:14:42 Job state: JOB_STATE_PENDING ...
2022/04/22 10:15:13 Job still running ...
2022/04/22 10:15:43 Job still running ...
2022/04/22 10:16:13 Job still running ...
2022/04/22 10:16:43 Job still running ...
2022/04/22 10:17:13 Job still running ...
2022/04/22 10:17:43 Failed to execute job: job 2022-04-22_03_14_42-6805910100148431205 failed
panic: Failed to execute job: job 2022-04-22_03_14_42-6805910100148431205 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202fa8, 0xc000120000, 0x10e17e5, 0x19, 0xc0004d1e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/otpyzep6gqcvu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #487

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/487/display/redirect?page=changes>

Changes:

[vachan] Annotating Read API tests.

[bulat.safiullin] [BEAM-14247] [Website] add image

[bulat.safiullin] [BEAM-14247] [Website] center image

[mattcasters] BEAM-1857 : CHANGES.md entry for 2.38.0

[mmack] [BEAM-14323] Improve IDE integration of Spark cross version builds

[noreply] [BEAM-14112] Fixed ReadFromBigQuery with Interactive Beam (#17306)

[noreply] Update .asf.yaml (#17409)

[noreply] [BEAM-14336] Sickbay flight delays test - dataset seems to be missing

[noreply] [BEAM-14338] Update watermark unit tests to use time.Time.Equals()

[noreply] [BEAM-14328] Tweaks to "Differences from pandas" page (#17413)

[Andrew Pilloud] [BEAM-14253] Disable broken test pending Dataflow fix

[yiru] fix: BigQuery Storage Connector trace id population missing bracket

[noreply] [BEAM-14330] Temporarily disable the clusters auto-cleanup (#17400)

[noreply] Update Beam website to release 2.38.0 (#17378)

[noreply] [BEAM-14213] Add API and construction time validation for Batched DoFns

[noreply] Minor: Update release guide regarding archive.apache.org (#17419)

[noreply] [BEAM-14017] beam_PreCommit_CommunityMetrics_Cron test failing (#17396)


------------------------------------------
[...truncated 17.28 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650536068770250889/****\022@4d222538e22f0fc5062c68be506100b4c690107fad0a1e4b53d593943d41a979"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/21 10:14:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650536068770250889/model
2022/04/21 10:14:29 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0421100305"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650536068770250889/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650536068770250889/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0421100305",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/21 10:14:29 Submitted job: 2022-04-21_03_14_29-13176856425987507621
2022/04/21 10:14:29 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-21_03_14_29-13176856425987507621?project=apache-beam-testing
2022/04/21 10:14:29 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-21_03_14_29-13176856425987507621
2022/04/21 10:14:29 Job state: JOB_STATE_PENDING ...
2022/04/21 10:14:59 Job still running ...
2022/04/21 10:15:30 Job still running ...
2022/04/21 10:16:00 Job still running ...
2022/04/21 10:16:30 Job still running ...
2022/04/21 10:17:00 Job still running ...
2022/04/21 10:17:30 Failed to execute job: job 2022-04-21_03_14_29-13176856425987507621 failed
panic: Failed to execute job: job 2022-04-21_03_14_29-13176856425987507621 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc000120000, 0x10e17e5, 0x19, 0xc000443e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 8s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/squahlukcpqtc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #486

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/486/display/redirect?page=changes>

Changes:

[andyye333] Change func to PTransform

[noreply] Populate actual dataflow job id to bigquery write trace id (#17130)

[relax] mark static thread as a daemon thread

[noreply] [BEAM-13866] Add miscellaneous exec unit tests (#17363)


------------------------------------------
[...truncated 17.40 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650449675670543170/****\022@4d222538e22f0fc5062c68be506100b4c690107fad0a1e4b53d593943d41a979"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/20 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650449675670543170/model
2022/04/20 10:14:36 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0420100239"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650449675670543170/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650449675670543170/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0420100239",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/20 10:14:36 Submitted job: 2022-04-20_03_14_36-18156406884419495368
2022/04/20 10:14:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-20_03_14_36-18156406884419495368?project=apache-beam-testing
2022/04/20 10:14:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-20_03_14_36-18156406884419495368
2022/04/20 10:14:36 Job state: JOB_STATE_PENDING ...
2022/04/20 10:15:06 Job still running ...
2022/04/20 10:15:37 Job still running ...
2022/04/20 10:16:07 Job still running ...
2022/04/20 10:16:37 Job still running ...
2022/04/20 10:17:07 Job still running ...
2022/04/20 10:17:37 Job still running ...
2022/04/20 10:18:07 Job still running ...
2022/04/20 10:18:37 Job still running ...
2022/04/20 10:19:07 Job still running ...
2022/04/20 10:19:37 Job still running ...
2022/04/20 10:20:08 Failed to execute job: job 2022-04-20_03_14_36-18156406884419495368 failed
panic: Failed to execute job: job 2022-04-20_03_14_36-18156406884419495368 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc0000480c0, 0x10e17e5, 0x19, 0xc0004d5e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/byvawt2gjw5lk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #485

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/485/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14251] add output_coder_override to ExpansionRequest

[Heejong Lee] remove null

[rarokni] [BEAM-14307] Fix Slow Side input pattern bug in sample

[Heejong Lee] better error msg

[Heejong Lee] update from comments

[noreply] [BEAM-14316] Introducing KafkaIO.Read implementation compatibility

[noreply] [BEAM-14290] Address staticcheck warnings in the reflectx package

[noreply] [BEAM-14302] Simply bools in fn.go, genx_test.go (#17356)

[noreply] Merge pull request #17382: [BEAM-12356] Close DatasetService leak as


------------------------------------------
[...truncated 17.38 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650363278918381490/****\022@4d222538e22f0fc5062c68be506100b4c690107fad0a1e4b53d593943d41a979"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/19 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650363278918381490/model
2022/04/19 10:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0419100246"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650363278918381490/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650363278918381490/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0419100246",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/19 10:14:40 Submitted job: 2022-04-19_03_14_39-10762265482278810311
2022/04/19 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-19_03_14_39-10762265482278810311?project=apache-beam-testing
2022/04/19 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-19_03_14_39-10762265482278810311
2022/04/19 10:14:40 Job state: JOB_STATE_PENDING ...
2022/04/19 10:15:10 Job still running ...
2022/04/19 10:15:40 Job still running ...
2022/04/19 10:16:10 Job still running ...
2022/04/19 10:16:40 Job still running ...
2022/04/19 10:17:10 Job still running ...
2022/04/19 10:17:40 Failed to execute job: job 2022-04-19_03_14_39-10762265482278810311 failed
panic: Failed to execute job: job 2022-04-19_03_14_39-10762265482278810311 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc0000480c0, 0x10e17e5, 0x19, 0xc000425e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/l3oavomb2bf6k

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #484

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/484/display/redirect>

Changes:


------------------------------------------
[...truncated 17.40 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650276873334395439/****\022@fbd883d0cd8077aa758484662e074ca8d3bfb25eef6678fa961d3d8b44296f38"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/18 10:14:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650276873334395439/model
2022/04/18 10:14:34 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0418100241"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650276873334395439/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650276873334395439/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0418100241",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/18 10:14:34 Submitted job: 2022-04-18_03_14_34-4223699733439530592
2022/04/18 10:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-18_03_14_34-4223699733439530592?project=apache-beam-testing
2022/04/18 10:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-18_03_14_34-4223699733439530592
2022/04/18 10:14:34 Job state: JOB_STATE_PENDING ...
2022/04/18 10:15:04 Job still running ...
2022/04/18 10:15:34 Job still running ...
2022/04/18 10:16:04 Job still running ...
2022/04/18 10:16:34 Job still running ...
2022/04/18 10:17:05 Job still running ...
2022/04/18 10:17:35 Failed to execute job: job 2022-04-18_03_14_34-4223699733439530592 failed
panic: Failed to execute job: job 2022-04-18_03_14_34-4223699733439530592 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc0000480c0, 0x10e17e5, 0x19, 0xc0005d1e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/baxhzgeqyfhq4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #483

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/483/display/redirect>

Changes:


------------------------------------------
[...truncated 17.46 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650190473191071286/****\022@fbd883d0cd8077aa758484662e074ca8d3bfb25eef6678fa961d3d8b44296f38"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/17 10:14:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650190473191071286/model
2022/04/17 10:14:33 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0417100245"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650190473191071286/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650190473191071286/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0417100245",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/17 10:14:34 Submitted job: 2022-04-17_03_14_33-3285411550073730087
2022/04/17 10:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-17_03_14_33-3285411550073730087?project=apache-beam-testing
2022/04/17 10:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-17_03_14_33-3285411550073730087
2022/04/17 10:14:34 Job state: JOB_STATE_PENDING ...
2022/04/17 10:15:04 Job still running ...
2022/04/17 10:15:35 Job still running ...
2022/04/17 10:16:05 Job still running ...
2022/04/17 10:16:35 Job still running ...
2022/04/17 10:17:05 Job still running ...
2022/04/17 10:17:35 Job still running ...
2022/04/17 10:18:05 Job still running ...
2022/04/17 10:18:35 Job still running ...
2022/04/17 10:19:05 Job still running ...
2022/04/17 10:19:35 Job still running ...
2022/04/17 10:20:05 Failed to execute job: job 2022-04-17_03_14_33-3285411550073730087 failed
panic: Failed to execute job: job 2022-04-17_03_14_33-3285411550073730087 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc000120000, 0x10e17e5, 0x19, 0xc000407e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 44s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/b67ndavy4v4wu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #482

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/482/display/redirect?page=changes>

Changes:

[pandiana] BigQueryServicesImpl: reduce number of threads spawned by

[noreply] [BEAM-13204] Fix website bug where code tabs do not appear if the


------------------------------------------
[...truncated 17.41 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650104076010616927/****\022@fbd883d0cd8077aa758484662e074ca8d3bfb25eef6678fa961d3d8b44296f38"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/16 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650104076010616927/model
2022/04/16 10:14:36 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0416100241"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650104076010616927/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650104076010616927/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0416100241",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/16 10:14:37 Submitted job: 2022-04-16_03_14_36-13122598132845091065
2022/04/16 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-16_03_14_36-13122598132845091065?project=apache-beam-testing
2022/04/16 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-16_03_14_36-13122598132845091065
2022/04/16 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/16 10:15:07 Job still running ...
2022/04/16 10:15:37 Job still running ...
2022/04/16 10:16:07 Job still running ...
2022/04/16 10:16:37 Job still running ...
2022/04/16 10:17:07 Job still running ...
2022/04/16 10:17:37 Job still running ...
2022/04/16 10:18:07 Failed to execute job: job 2022-04-16_03_14_36-13122598132845091065 failed
panic: Failed to execute job: job 2022-04-16_03_14_36-13122598132845091065 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc000120000, 0x10e17e5, 0x19, 0xc0009bfe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5we4slj4xxj52

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #481

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/481/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Upgrade to Gradle 7.4

[Kenneth Knowles] Remove Python module dependency on Dataflow worker

[noreply] [BEAM-13925] Dont double assign committers if author or other reviewer

[noreply] [BEAM-13739] Remove deprecated shallow clone funcs (#17362)

[noreply] [BEAM-11104] Pipe Continuation to DataSource level (#17334)

[noreply] [BEAM-11105] Basic Watermark Estimation (Wall Clock Observing) (#17267)

[noreply] Respect output coder for TextIO. (#17367)

[noreply] Merge pull request #17200 from [BEAM-12164]: fix the autoscaling backlog

[noreply] [BEAM-17035] Call python3 directly when it is available. (#17366)

[noreply] Merge pull request #17375: [BEAM-8691] Declare newer


------------------------------------------
[...truncated 17.38 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650017681452085711/****\022@fbd883d0cd8077aa758484662e074ca8d3bfb25eef6678fa961d3d8b44296f38"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/15 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650017681452085711/model
2022/04/15 10:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0415100236"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650017681452085711/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650017681452085711/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0415100236",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/15 10:14:45 Submitted job: 2022-04-15_03_14_42-3710367742580606060
2022/04/15 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-15_03_14_42-3710367742580606060?project=apache-beam-testing
2022/04/15 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-15_03_14_42-3710367742580606060
2022/04/15 10:14:45 Job state: JOB_STATE_PENDING ...
2022/04/15 10:15:15 Job still running ...
2022/04/15 10:15:45 Job still running ...
2022/04/15 10:16:16 Job still running ...
2022/04/15 10:16:46 Job still running ...
2022/04/15 10:17:16 Job still running ...
2022/04/15 10:17:46 Failed to execute job: job 2022-04-15_03_14_42-3710367742580606060 failed
panic: Failed to execute job: job 2022-04-15_03_14_42-3710367742580606060 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1202f28, 0xc0000480c0, 0x10e17e5, 0x19, 0xc000565e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 24s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/zbjr6v52urjzc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #480

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/480/display/redirect?page=changes>

Changes:

[relax] handle changing schemas in Storage API sink

[noreply] Fix a couple style issues (#17361)

[noreply] [BEAM-14287] Clean up staticcheck warnings in graph/coder (#17337)

[noreply] Improvements to dataflow job service for non-Python jobs. (#17338)

[noreply] Bump minimist (#17290)

[noreply] Bump ansi-regex (#17291)

[noreply] Bump nanoid (#17292)

[noreply] Bump lodash (#17293)

[noreply] Bump url-parse (#17294)

[noreply] Bump moment (#17328)

[noreply] Merge pull request #15549 from [BEAM-11997] Changed RedisIO


------------------------------------------
[...truncated 17.43 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649931279250629840/****\022@19d14d7fce413a96bb14c58678dcb579ec82c5034a1257f74abaf7163cafe3a9"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/14 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649931279250629840/model
2022/04/14 10:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0414100250"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649931279250629840/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649931279250629840/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0414100250",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/14 10:14:41 Submitted job: 2022-04-14_03_14_39-6638205837349465376
2022/04/14 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-14_03_14_39-6638205837349465376?project=apache-beam-testing
2022/04/14 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-14_03_14_39-6638205837349465376
2022/04/14 10:14:41 Job state: JOB_STATE_PENDING ...
2022/04/14 10:15:11 Job still running ...
2022/04/14 10:15:41 Job still running ...
2022/04/14 10:16:11 Job still running ...
2022/04/14 10:16:41 Job still running ...
2022/04/14 10:17:11 Job still running ...
2022/04/14 10:17:41 Job still running ...
2022/04/14 10:18:11 Job still running ...
2022/04/14 10:18:41 Job still running ...
2022/04/14 10:19:11 Job still running ...
2022/04/14 10:19:41 Job still running ...
2022/04/14 10:20:12 Failed to execute job: job 2022-04-14_03_14_39-6638205837349465376 failed
panic: Failed to execute job: job 2022-04-14_03_14_39-6638205837349465376 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fe8e8, 0xc00018a000, 0x10dd90d, 0x19, 0xc00056de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/oc7a5hl2bylhk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #479

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/479/display/redirect?page=changes>

Changes:

[Valentyn Tymofieiev] Add remaining Dataflow test suites for Python 3.9.

[Heejong Lee] [BEAM-14232] Only resolve artifacts in expanded environments for Java

[noreply] Fix test ordering issue (#17350)

[buqian] Do not pass null to MoreObjects.firstNonNull as default value

[ningkang0957] [BEAM-14288] Fixed flaky test

[noreply] [BEAM-14277] Disables Spanner change streams tests (#17346)

[noreply] [BEAM-14219] Run cleanup script to remove stale prebuilt SDK container

[Heejong Lee] [BEAM-14300] Fix Java precommit failure

[noreply] [BEAM-14116] Rollback "Chunk commit requests dynamically (#17004)"

[noreply] [BEAM-13982] A base class for run inference (#16970)

[ningkang0957] Enumerates all possible expected strings when asserting

[noreply] [BEAM-13966] Add pivot(), a non-deferred column operation on categorical


------------------------------------------
[...truncated 17.44 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649844878536599605/****\022@65878b4c34e53f51ca26a8ce87734b9e3068cd88bdf9ae6d73b98cf9dcbc2a26"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/13 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649844878536599605/model
2022/04/13 10:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0413100239"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649844878536599605/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649844878536599605/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0413100239",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/13 10:14:39 Submitted job: 2022-04-13_03_14_39-17597835399636276592
2022/04/13 10:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-13_03_14_39-17597835399636276592?project=apache-beam-testing
2022/04/13 10:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-13_03_14_39-17597835399636276592
2022/04/13 10:14:40 Job state: JOB_STATE_PENDING ...
2022/04/13 10:15:10 Job still running ...
2022/04/13 10:15:40 Job still running ...
2022/04/13 10:16:10 Job still running ...
2022/04/13 10:16:40 Job still running ...
2022/04/13 10:17:10 Job still running ...
2022/04/13 10:17:40 Job still running ...
2022/04/13 10:18:10 Job still running ...
2022/04/13 10:18:40 Job still running ...
2022/04/13 10:19:10 Job still running ...
2022/04/13 10:19:40 Job still running ...
2022/04/13 10:20:10 Failed to execute job: job 2022-04-13_03_14_39-17597835399636276592 failed
panic: Failed to execute job: job 2022-04-13_03_14_39-17597835399636276592 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fe8e8, 0xc0000480c0, 0x10dd90d, 0x19, 0xc0003abe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vx6hxzxgoa54u

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #478

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/478/display/redirect?page=changes>

Changes:

[kamil.bregula] [BEAM-14215] Improve argument validation in SnowflakeIO

[benjamin.gonzalez] [BEAM-14013] Add PreCommit Kotlin examples Jenkins Job

[Andrew Pilloud] [BEAM-13151] Support multiple layers of AutoValue nesting

[Heejong Lee] [BEAM-14233] Merge requirements from expanded response for Java External

[benjamin.gonzalez] [BEAM-14013] Add spark, direct, flink runners as triggers for Kotlin

[noreply] [BEAM-13898] Add tests to the pubsubx package. (#17324)

[noreply] [BEAM-14285] Clean up Staticcheck Warnings in io packages (#17336)

[noreply] [BEAM-14187] Fix concurrency issue in IsmReaderImpl (#17201)

[noreply] [BEAM-14288] Skip flaking test

[noreply] Simplify specifying additional dependencies in Go SDK in XLang IOs

[noreply] [BEAM-14240] Clean staticcheck warnings in runner packages (#17340)

[Daniel Oliveira] [BEAM-13538] Workaround to fix go-licenses crash.


------------------------------------------
[...truncated 17.38 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649758476361917818/****\022@65878b4c34e53f51ca26a8ce87734b9e3068cd88bdf9ae6d73b98cf9dcbc2a26"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/12 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649758476361917818/model
2022/04/12 10:14:36 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0412100253"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649758476361917818/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649758476361917818/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0412100253",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/12 10:14:37 Submitted job: 2022-04-12_03_14_37-15185391582769658392
2022/04/12 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-12_03_14_37-15185391582769658392?project=apache-beam-testing
2022/04/12 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-12_03_14_37-15185391582769658392
2022/04/12 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/12 10:15:07 Job still running ...
2022/04/12 10:15:37 Job still running ...
2022/04/12 10:16:07 Job still running ...
2022/04/12 10:16:37 Job still running ...
2022/04/12 10:17:07 Job still running ...
2022/04/12 10:17:37 Failed to execute job: job 2022-04-12_03_14_37-15185391582769658392 failed
panic: Failed to execute job: job 2022-04-12_03_14_37-15185391582769658392 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fe8e8, 0xc000120000, 0x10dd90d, 0x19, 0xc0004bfe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 16s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/twfdroim2qckq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #477

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/477/display/redirect>

Changes:


------------------------------------------
[...truncated 17.38 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649672078838612141/****\022@aa82da42294c826fa79f98c59d8420af270ba6d1a4bf922421e49984379b1c05"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/11 10:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649672078838612141/model
2022/04/11 10:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0411100250"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649672078838612141/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649672078838612141/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0411100250",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/11 10:14:40 Submitted job: 2022-04-11_03_14_39-14049673898573676319
2022/04/11 10:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-11_03_14_39-14049673898573676319?project=apache-beam-testing
2022/04/11 10:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-11_03_14_39-14049673898573676319
2022/04/11 10:14:40 Job state: JOB_STATE_PENDING ...
2022/04/11 10:15:10 Job still running ...
2022/04/11 10:15:40 Job still running ...
2022/04/11 10:16:10 Job still running ...
2022/04/11 10:16:40 Job still running ...
2022/04/11 10:17:10 Job still running ...
2022/04/11 10:17:40 Job still running ...
2022/04/11 10:18:10 Failed to execute job: job 2022-04-11_03_14_39-14049673898573676319 failed
panic: Failed to execute job: job 2022-04-11_03_14_39-14049673898573676319 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc148, 0xc0000480c0, 0x10db399, 0x19, 0xc00039be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/awehmhc6km3oc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #476

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/476/display/redirect?page=changes>

Changes:

[chamikaramj] Re-raise exceptions swallowed in several Python I/O connectors

[noreply] Merge pull request #16928: [BEAM-11971] Re add reverted timer


------------------------------------------
[...truncated 17.38 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649585675332914703/****\022@aa82da42294c826fa79f98c59d8420af270ba6d1a4bf922421e49984379b1c05"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/10 10:14:35 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649585675332914703/model
2022/04/10 10:14:35 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0410100248"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649585675332914703/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649585675332914703/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0410100248",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/10 10:14:36 Submitted job: 2022-04-10_03_14_35-18408452118090579646
2022/04/10 10:14:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-10_03_14_35-18408452118090579646?project=apache-beam-testing
2022/04/10 10:14:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-10_03_14_35-18408452118090579646
2022/04/10 10:14:36 Job state: JOB_STATE_PENDING ...
2022/04/10 10:15:06 Job still running ...
2022/04/10 10:15:36 Job still running ...
2022/04/10 10:16:06 Job still running ...
2022/04/10 10:16:36 Job still running ...
2022/04/10 10:17:06 Job still running ...
2022/04/10 10:17:36 Job still running ...
2022/04/10 10:18:06 Failed to execute job: job 2022-04-10_03_14_35-18408452118090579646 failed
panic: Failed to execute job: job 2022-04-10_03_14_35-18408452118090579646 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc148, 0xc000120000, 0x10db399, 0x19, 0xc000573e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 45s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ie2kpi5o4uhgw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #475

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/475/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-11714] Change spotBugs jenkins config

[Robert Bradshaw] Cleanup docs on Shared.

[Kyle Weaver] Nit: correct description for precommit cron jobs.

[benjamin.gonzalez] [BEAM-11714] Add dummy class for testing

[benjamin.gonzalez] [BEAM-11714] Remove dummy class used for testing

[benjamin.gonzalez] [BEAM-11714] Spotbugs print toJenkins UI precommit_Java17

[noreply] [BEAM-13767] Remove eclipse plugin as it generates a lot of unused tasks

[noreply] [BEAM-10708] Updated beam_sql error message (#17314)

[noreply] [BEAM-14281] add as_deterministic_coder to nullable coder (#17322)

[noreply] Improvements to Beam/Spark quickstart. (#17129)

[chamikaramj] Disable BigQueryIOStorageWriteIT for Runner v2 test suite


------------------------------------------
[...truncated 17.45 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649499276142344912/****\022@aa82da42294c826fa79f98c59d8420af270ba6d1a4bf922421e49984379b1c05"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/09 10:14:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649499276142344912/model
2022/04/09 10:14:36 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0409100244"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649499276142344912/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649499276142344912/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0409100244",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/09 10:14:37 Submitted job: 2022-04-09_03_14_36-12067842526843397777
2022/04/09 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-09_03_14_36-12067842526843397777?project=apache-beam-testing
2022/04/09 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-09_03_14_36-12067842526843397777
2022/04/09 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/09 10:15:07 Job still running ...
2022/04/09 10:15:37 Job still running ...
2022/04/09 10:16:07 Job still running ...
2022/04/09 10:16:37 Job still running ...
2022/04/09 10:17:07 Job still running ...
2022/04/09 10:17:37 Job still running ...
2022/04/09 10:18:07 Job still running ...
2022/04/09 10:18:37 Job still running ...
2022/04/09 10:19:07 Job still running ...
2022/04/09 10:19:37 Job still running ...
2022/04/09 10:20:08 Failed to execute job: job 2022-04-09_03_14_36-12067842526843397777 failed
panic: Failed to execute job: job 2022-04-09_03_14_36-12067842526843397777 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc148, 0xc0000480c0, 0x10db399, 0x19, 0xc0003abe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5rvcnlzfz6jdy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #474

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/474/display/redirect?page=changes>

Changes:

[johnjcasey] [BEAM-10529] add java and generic components of nullable xlang tests

[johnjcasey] [BEAM-10529] fix test case

[johnjcasey] [BEAM-10529] add coders and typehints to support nullable xlang coders

[johnjcasey] [BEAM-10529] update external builder to support nullable coder

[johnjcasey] [BEAM-10529] clean up coders.py

[johnjcasey] [BEAM-10529] add coder translation test

[johnjcasey] [BEAM-10529] add additional check to typecoder to not accidentally

[johnjcasey] [BEAM-10529] add test to retrieve nullable coder from typehint

[johnjcasey] [BEAM-10529] run spotless

[johnjcasey] [BEAM-10529] add go nullable coder

[johnjcasey] [BEAM-10529] cleanup extra println

[johnjcasey] [BEAM-10529] improve comments, clean up python

[bulat.safiullin] [BEAM-13992] [Website] update Contribute/Code Contribution Guide page

[bulat.safiullin] [BEAM-13992] [Website] change text, transfer tag a

[bulat.safiullin] [BEAM-13992] [Website] change code tags

[bulat.safiullin] [BEAM-13992] [Website] change text

[bulat.safiullin] [BEAM-13992] [Website] change text and links, add empty lines

[bulat.safiullin] [BEAM-13991] [Website] change links, add contribute file

[bulat.safiullin] [BEAM-13991] [Website] add content, add styles

[bulat.safiullin] [BEAM-13991] [Website] add images, add styles, delete spaces

[bulat.safiullin] [BEAM-13991] [Website] change url and aliases, delete bullet points

[bulat.safiullin] [BEAM-13991] [Website] add empty line

[bulat.safiullin] [BEAM-13992] [Website] change links, change text

[bulat.safiullin] [BEAM-13992] [Website] change links, add text, add dots

[bulat.safiullin] [BEAM-13992] [Website] change links, change text

[bulat.safiullin] [BEAM-13991] [Website] change styles, change quotes

[bulat.safiullin] [BEAM-13991] [Website] change link color

[bulat.safiullin] [BEAM-13992] [Website] change text, delete whitespace

[bulat.safiullin] [BEAM-13991] [Website] change text

[bulat.safiullin] [BEAM-13992] [Website] update text

[bulat.safiullin] [BEAM-13991] [Website] added changes from PR 13992, changed get-starting

[shivrajw] [BEAM-14236] Parquet IO support for list to conform with Apache Parquet

[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -

[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -

[mmack] [BEAM-14104] Support shard aware aggregation in Kinesis writer.

[noreply] [BEAM-13015] Lookup the container for the step once when registering

[noreply] [BEAM-14175] Log read loop abort at debug rather than error (#17183)

[noreply] [BEAM-11745] Fix author list rendering (#17308)

[noreply] [BEAM-14144] Record JFR profiles when GC thrashing is detected (#17151)

[noreply] Factors enable_prime flag in when checking use_unified_worker conditions

[noreply] [BEAM-11104] Add ProcessContinuation type to Go SDK (#17265)

[noreply] BEAM-13939: Restructure Protos to fix namespace conflicts (#16961)

[noreply] [BEAM-14270] Mark {Snowflake/BigQuery}Services as @Internal (#17309)

[noreply] [BEAM-13901] Add unit tests for graphx/cogbk.go

[noreply] [BEAM-14259, BEAM-14266] Remove unused function, replace use of ptypes

[noreply] [BEAM-14274] Fix staticcheck warnings in pipelinex (#17311)

[noreply] [BEAM-13857] Switched Go IT script to using Go flags for expansion

[noreply] Update python beam-master container image. (#17313)


------------------------------------------
[...truncated 17.36 KB...]
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649412882473309555/****\022@aa82da42294c826fa79f98c59d8420af270ba6d1a4bf922421e49984379b1c05"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/08 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649412882473309555/model
2022/04/08 10:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0408100245"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649412882473309555/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649412882473309555/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0408100245",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/08 10:14:43 Submitted job: 2022-04-08_03_14_43-3676575395985554251
2022/04/08 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-08_03_14_43-3676575395985554251?project=apache-beam-testing
2022/04/08 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-08_03_14_43-3676575395985554251
2022/04/08 10:14:43 Job state: JOB_STATE_PENDING ...
2022/04/08 10:15:13 Job still running ...
2022/04/08 10:15:43 Job still running ...
2022/04/08 10:16:13 Job still running ...
2022/04/08 10:16:43 Job still running ...
2022/04/08 10:17:13 Job still running ...
2022/04/08 10:17:44 Job still running ...
2022/04/08 10:18:14 Job still running ...
2022/04/08 10:18:44 Failed to execute job: job 2022-04-08_03_14_43-3676575395985554251 failed
panic: Failed to execute job: job 2022-04-08_03_14_43-3676575395985554251 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc148, 0xc0000480c0, 0x10db399, 0x19, 0xc00066de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/52zutkdtpvnfy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #473

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/473/display/redirect?page=changes>

Changes:

[noreply] Avoid pr-bot state desync (#17299)

[noreply] [BEAM-14259] Clean up staticcheck warnings in the exec package (#17285)

[noreply] Minor: Prefer registered schema in SQL docs (#17298)

[Kyle Weaver] [BEAM-14262] Update plugins for Dockerized Jenkins.

[Kyle Weaver] Add ansicolor and ws-cleanup plugins.

[noreply] [Playground] add meta tags (#17207)

[noreply] fixes golint and deprecated issues in recent Go SDK import (#17304)

[noreply] [BEAM-14266] Replace deprecated ptypes package uses (#17302)

[noreply] [BEAM-11936] Fix rawtypes warnings in SnowflakeIO (#17257)

[noreply] Merge pull request #17262: [BEAM-14244] Use the supplied output


------------------------------------------
[...truncated 17.43 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649326481606002600/****\022@ff9da1c6a12e416e26682a766904acb2b955ec7c22d4946aefa06272e93b9920"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/07 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649326481606002600/model
2022/04/07 10:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0407100254"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649326481606002600/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649326481606002600/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0407100254",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/07 10:14:42 Submitted job: 2022-04-07_03_14_42-10013493717965427462
2022/04/07 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-07_03_14_42-10013493717965427462?project=apache-beam-testing
2022/04/07 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-07_03_14_42-10013493717965427462
2022/04/07 10:14:42 Job state: JOB_STATE_PENDING ...
2022/04/07 10:15:12 Job still running ...
2022/04/07 10:15:42 Job still running ...
2022/04/07 10:16:13 Job still running ...
2022/04/07 10:16:43 Job still running ...
2022/04/07 10:17:13 Job still running ...
2022/04/07 10:17:43 Job still running ...
2022/04/07 10:18:13 Failed to execute job: job 2022-04-07_03_14_42-10013493717965427462 failed
panic: Failed to execute job: job 2022-04-07_03_14_42-10013493717965427462 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11f7b48, 0xc0000480c0, 0x10d748c, 0x19, 0xc0007e7e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/srpchknfqzyj4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #472

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/472/display/redirect?page=changes>

Changes:

[bingyeli] update query

[Robert Bradshaw] [BEAM-14250] Fix coder registration for types defined in __main__.

[johnjcasey] [BEAM-14256] update SpEL dependency to 5.3.18.RELEASE

[johnjcasey] [BEAM-14256] remove .RELEASE

[dannymccormick] Fix dependency issue causing failures

[Kyle Weaver] [BEAM-9649] Add region option to Mongo Dataflow test.

[noreply] Allow get_coder(None).

[noreply] [BEAM-13015] Disable retries for fnapi grpc channels which otherwise

[noreply] [BEAM-13952] Sickbay

[noreply] BEAM-14235 parquetio module does not parse PEP-440 compliant Pyarrow

[noreply] [Website] Contribution guide page indent bug fix (#17287)

[noreply] [BEAM-10976] Document go sdk bundle finalization (#17048)

[noreply] [BEAM-13829] Expose status API from Go SDK Harness (#16957)


------------------------------------------
[...truncated 17.44 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649240082267528843/****\022@6878e07e288bc427aaf2db6161ed510e6d7e52c4aa924632e6355f4597ae7296"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/06 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649240082267528843/model
2022/04/06 10:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0406100250"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649240082267528843/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649240082267528843/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0406100250",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/06 10:14:43 Submitted job: 2022-04-06_03_14_43-6598375069367508471
2022/04/06 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-06_03_14_43-6598375069367508471?project=apache-beam-testing
2022/04/06 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-06_03_14_43-6598375069367508471
2022/04/06 10:14:43 Job state: JOB_STATE_PENDING ...
2022/04/06 10:15:13 Job still running ...
2022/04/06 10:15:43 Job still running ...
2022/04/06 10:16:13 Job still running ...
2022/04/06 10:16:43 Job still running ...
2022/04/06 10:17:13 Job still running ...
2022/04/06 10:17:43 Job still running ...
2022/04/06 10:18:13 Job still running ...
2022/04/06 10:18:44 Job still running ...
2022/04/06 10:19:14 Job still running ...
2022/04/06 10:19:44 Job still running ...
2022/04/06 10:20:16 Job still running ...
2022/04/06 10:20:46 Failed to execute job: job 2022-04-06_03_14_43-6598375069367508471 failed
panic: Failed to execute job: job 2022-04-06_03_14_43-6598375069367508471 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11f7ac8, 0xc0000480c0, 0x10d748c, 0x19, 0xc00040be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/hl5cslh5qodw2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #471

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/471/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-8970] Add docs to run wordcount example on portable Spark Runner

[Kiley Sok] Update python container version

[benjamin.gonzalez] [BEAM-8970] Add period to end of sentence

[Kyle Weaver] Add self-descriptive message for expected errors.

[noreply] Add --dataflowServiceOptions=enable_prime to useUnifiedWorker conditions

[noreply] [BEAM-10529] nullable xlang coder (#16923)

[noreply] Fix go fmt break in core/typex/special.go (#17266)

[noreply] [BEAM-5436] Add doc page on Go cross compilation. (#17256)

[noreply] Pr-bot Don't count all reviews as approvals (#17269)

[noreply] Fix postcommits (#17263)

[noreply] [BEAM-14241] Address staticcheck warnings in boot.go (#17264)

[noreply] [BEAM-14157] GrpcWindmillServer: Use stream specific boolean to do

[noreply] [BEAM-10582] Allow (and test) pyarrow 7 (#17229)

[noreply] [BEAM-13519] Solve race issues when the server responds with an error


------------------------------------------
[...truncated 17.39 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649153674095282744/****\022@c0e37d558209c73c316caf100086463c2bceae4d3f2115ee97b381f760958fc9"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/05 10:14:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649153674095282744/model
2022/04/05 10:14:34 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0405100254"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649153674095282744/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649153674095282744/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0405100254",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/05 10:14:35 Submitted job: 2022-04-05_03_14_34-9484889235192568798
2022/04/05 10:14:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-05_03_14_34-9484889235192568798?project=apache-beam-testing
2022/04/05 10:14:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-05_03_14_34-9484889235192568798
2022/04/05 10:14:35 Job state: JOB_STATE_PENDING ...
2022/04/05 10:15:05 Job still running ...
2022/04/05 10:15:35 Job still running ...
2022/04/05 10:16:05 Job still running ...
2022/04/05 10:16:35 Job still running ...
2022/04/05 10:17:05 Job still running ...
2022/04/05 10:17:35 Job still running ...
2022/04/05 10:18:05 Job still running ...
2022/04/05 10:18:35 Job still running ...
2022/04/05 10:19:05 Job still running ...
2022/04/05 10:19:35 Job still running ...
2022/04/05 10:20:05 Failed to execute job: job 2022-04-05_03_14_34-9484889235192568798 failed
panic: Failed to execute job: job 2022-04-05_03_14_34-9484889235192568798 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11575e8, 0xc0000480c0, 0x1044372, 0x19, 0xc0003e7e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/oce44cfmd36qg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #470

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/470/display/redirect>

Changes:


------------------------------------------
[...truncated 17.36 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649067276458689654/****\022@14d013210e81652a4a20d02dcca9120e09485f05b890e10035939551fd69ef90"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/04 10:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649067276458689654/model
2022/04/04 10:14:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0404100246"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649067276458689654/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649067276458689654/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0404100246",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/04 10:14:37 Submitted job: 2022-04-04_03_14_37-15501053708556834841
2022/04/04 10:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-04_03_14_37-15501053708556834841?project=apache-beam-testing
2022/04/04 10:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-04_03_14_37-15501053708556834841
2022/04/04 10:14:37 Job state: JOB_STATE_PENDING ...
2022/04/04 10:15:07 Job still running ...
2022/04/04 10:15:37 Job still running ...
2022/04/04 10:16:07 Job still running ...
2022/04/04 10:16:37 Job still running ...
2022/04/04 10:17:07 Job still running ...
2022/04/04 10:17:37 Job still running ...
2022/04/04 10:18:07 Failed to execute job: job 2022-04-04_03_14_37-15501053708556834841 failed
panic: Failed to execute job: job 2022-04-04_03_14_37-15501053708556834841 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1155108, 0xc0000480c0, 0x104200d, 0x19, 0xc00034de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/zmleq2djn3acg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #469

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/469/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14143] Simplifies the ExternalPythonTransform API (#17101)


------------------------------------------
[...truncated 17.40 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648980878270705883/****\022@14d013210e81652a4a20d02dcca9120e09485f05b890e10035939551fd69ef90"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/03 10:14:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648980878270705883/model
2022/04/03 10:14:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0403100304"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648980878270705883/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648980878270705883/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0403100304",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/03 10:14:39 Submitted job: 2022-04-03_03_14_38-13202730285513445682
2022/04/03 10:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-03_03_14_38-13202730285513445682?project=apache-beam-testing
2022/04/03 10:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-03_03_14_38-13202730285513445682
2022/04/03 10:14:39 Job state: JOB_STATE_PENDING ...
2022/04/03 10:15:09 Job still running ...
2022/04/03 10:15:39 Job still running ...
2022/04/03 10:16:09 Job still running ...
2022/04/03 10:16:39 Job still running ...
2022/04/03 10:17:09 Job still running ...
2022/04/03 10:17:39 Job still running ...
2022/04/03 10:18:09 Job still running ...
2022/04/03 10:18:39 Job still running ...
2022/04/03 10:19:09 Job still running ...
2022/04/03 10:19:39 Job still running ...
2022/04/03 10:20:09 Failed to execute job: job 2022-04-03_03_14_38-13202730285513445682 failed
panic: Failed to execute job: job 2022-04-03_03_14_38-13202730285513445682 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1155108, 0xc00018a000, 0x104200d, 0x19, 0xc000463e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/pzhrmg6gzkani

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #468

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/468/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14133] Fix potential NPE in BigQueryServicesImpl.getErrorInfo

[Robert Bradshaw] Revert "Revert "[BEAM-14038] Auto-startup for Python expansion service.

[Robert Bradshaw] Skip failing test for now.

[Kyle Weaver] [BEAM-14225] load balance jenkins jobs

[noreply] [BEAM-14153] Reshuffled Row Coder PCollection used as Side Input cause

[noreply] delint go sdk (#17247)

[Heejong Lee] add test

[noreply] Merge pull request #16841 from [BEAM-8823] Make FnApiRunner work by

[noreply] [BEAM-14192] Update legacy container version (#17210)

[noreply] Fix mishandling of API with BQIO (#17211)

[noreply] [BEAM-14221] Update documentation with Flink on Dataproc features

[Kiley Sok] Revert "[BEAM-14190] Python sends dataflow schema field"


------------------------------------------
[...truncated 17.34 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648894485085911039/****\022@14d013210e81652a4a20d02dcca9120e09485f05b890e10035939551fd69ef90"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/02 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648894485085911039/model
2022/04/02 10:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0402100250"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648894485085911039/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648894485085911039/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0402100250",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/02 10:14:46 Submitted job: 2022-04-02_03_14_45-15346524103016869680
2022/04/02 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-02_03_14_45-15346524103016869680?project=apache-beam-testing
2022/04/02 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-02_03_14_45-15346524103016869680
2022/04/02 10:14:46 Job state: JOB_STATE_PENDING ...
2022/04/02 10:15:16 Job still running ...
2022/04/02 10:15:46 Job still running ...
2022/04/02 10:16:16 Job still running ...
2022/04/02 10:16:46 Job still running ...
2022/04/02 10:17:16 Job still running ...
2022/04/02 10:17:46 Job still running ...
2022/04/02 10:18:16 Failed to execute job: job 2022-04-02_03_14_45-15346524103016869680 failed
panic: Failed to execute job: job 2022-04-02_03_14_45-15346524103016869680 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1155108, 0xc000120000, 0x104200d, 0x19, 0xc0004c3e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ssevphaxe5r4i

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #467

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/467/display/redirect?page=changes>

Changes:

[bulat.safiullin] [BEAM-14164] [Website] change styles

[Andrew Pilloud] [BEAM-14190] Python sends dataflow schema field

[noreply] [BEAM-14179] Fix possibly null value

[noreply] [BEAM-12815] Try to fix flaky Flink Post Commit (#17227)

[noreply] Add a portable job server that proxies the Dataflow backend. (#17189)

[noreply] [BEAM-14130] Implement JupyterLab extension for managing Dataproc

[Andrew Pilloud] [BEAM-13741] Remove forced calcite dependency from BaseBeamTable

[noreply] [BEAM-13951] Update release guide with pointers on updating


------------------------------------------
[...truncated 17.36 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648808084554651243/****\022@0a2515b258d512663b06d3c08fc54a898f18b4bc2ae6baac2d4ff0600a8a2fb4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/01 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648808084554651243/model
2022/04/01 10:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0401100242"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648808084554651243/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648808084554651243/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0401100242",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/01 10:14:45 Submitted job: 2022-04-01_03_14_45-4911904483344932145
2022/04/01 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-01_03_14_45-4911904483344932145?project=apache-beam-testing
2022/04/01 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-01_03_14_45-4911904483344932145
2022/04/01 10:14:45 Job state: JOB_STATE_PENDING ...
2022/04/01 10:15:15 Job still running ...
2022/04/01 10:15:45 Job still running ...
2022/04/01 10:16:15 Job still running ...
2022/04/01 10:16:45 Job still running ...
2022/04/01 10:17:15 Job still running ...
2022/04/01 10:17:46 Job still running ...
2022/04/01 10:18:16 Failed to execute job: job 2022-04-01_03_14_45-4911904483344932145 failed
panic: Failed to execute job: job 2022-04-01_03_14_45-4911904483344932145 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11533e8, 0xc000120000, 0x104060d, 0x19, 0xc0002e1e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/qbyknyjhg5uxk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #466

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/466/display/redirect?page=changes>

Changes:

[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn

[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn

[egalpin] [BEAM-14003] Adds compat for Elasticsearch 8.0.0

[egalpin] [BEAM-13136] Removes support for Elasticsearch 2.x

[noreply] Merge pull request #17149 from [BEAM-13883] [Playground] Increase test

[Kiley Sok] ignore test

[noreply] [BEAM-13948] Add unstack(), a non-deferred column operation on

[noreply] [BEAM-10976] Bundle finalization: E2E support (#17045)


------------------------------------------
[...truncated 17.35 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648721687035873034/****\022@0a2515b258d512663b06d3c08fc54a898f18b4bc2ae6baac2d4ff0600a8a2fb4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/31 10:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648721687035873034/model
2022/03/31 10:14:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0331100241"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648721687035873034/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648721687035873034/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0331100241",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/31 10:14:48 Submitted job: 2022-03-31_03_14_47-6064836055298254799
2022/03/31 10:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-31_03_14_47-6064836055298254799?project=apache-beam-testing
2022/03/31 10:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-31_03_14_47-6064836055298254799
2022/03/31 10:14:48 Job state: JOB_STATE_PENDING ...
2022/03/31 10:15:18 Job still running ...
2022/03/31 10:15:48 Job still running ...
2022/03/31 10:16:18 Job still running ...
2022/03/31 10:16:48 Job still running ...
2022/03/31 10:17:18 Job still running ...
2022/03/31 10:17:48 Job still running ...
2022/03/31 10:18:18 Failed to execute job: job 2022-03-31_03_14_47-6064836055298254799 failed
panic: Failed to execute job: job 2022-03-31_03_14_47-6064836055298254799 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11533e8, 0xc0000480c0, 0x104060d, 0x19, 0xc0005e9e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rucagv6gmoqks

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #465

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/465/display/redirect?page=changes>

Changes:

[vachan] Update display data to include BQ information.

[noreply] Revert "[BEAM-14084] iterable_input_value_types changed from list to

[chamikaramj] Convert URLs to local jars when constructing filesToStage

[Valentyn Tymofieiev] Ensure the removed option prebuild_sdk_container_base_image not used on

[noreply] [BEAM-13314]Revise recommendations to manage Python pipeline

[noreply] Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for

[noreply] Merge pull request #17080 from [BEAM-13880] [Playground] Increase test

[noreply] Merge pull request #17050 from [BEAM-13877] [Playground] Increase test

[noreply] [BEAM-14200] Improve SamzaJobInvoker extensibility (#17212)

[noreply] Merge pull request #17148 from [BEAM-14042] [playground] Scroll imports

[noreply] [BEAM-13918] Increase datastoreio go sdk unit test coverage (#17173)

[noreply] Merge pull request #16819: [BEAM-13806] Adding test suite for Go x-lang


------------------------------------------
[...truncated 17.37 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648635307887305359/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/30 10:15:08 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648635307887305359/model
2022/03/30 10:15:08 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0330100232"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648635307887305359/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648635307887305359/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0330100232",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/30 10:15:09 Submitted job: 2022-03-30_03_15_08-9806696987992009361
2022/03/30 10:15:09 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-30_03_15_08-9806696987992009361?project=apache-beam-testing
2022/03/30 10:15:09 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-30_03_15_08-9806696987992009361
2022/03/30 10:15:09 Job state: JOB_STATE_PENDING ...
2022/03/30 10:15:39 Job still running ...
2022/03/30 10:16:09 Job still running ...
2022/03/30 10:16:39 Job still running ...
2022/03/30 10:17:09 Job still running ...
2022/03/30 10:17:39 Job still running ...
2022/03/30 10:18:09 Job still running ...
2022/03/30 10:18:39 Job still running ...
2022/03/30 10:19:09 Job still running ...
2022/03/30 10:19:39 Job still running ...
2022/03/30 10:20:09 Job still running ...
2022/03/30 10:20:40 Failed to execute job: job 2022-03-30_03_15_08-9806696987992009361 failed
panic: Failed to execute job: job 2022-03-30_03_15_08-9806696987992009361 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc000407e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ljescqonwkbna

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #464

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/464/display/redirect?page=changes>

Changes:

[hengfeng] feat: remove the metadata table after the pipeline finishes

[thiagotnunes] test: add test for metadata table dropping

[noreply] Minor: Add warning about pubsub client to Beam 2.36.0 blog (#17188)

[noreply] [BEAM-14177] Fix GBK re-iteration caching for portable runners. (#17184)

[noreply] Merge pull request #17187: [BEAM-14181] Make sure to evict connections

[noreply] Only reset transform.label if it is correctly assigned (#17192)

[noreply] [BEAM-12641] Use google-auth instead of oauth2client for GCP auth

[Robert Bradshaw] [BEAM-14163] Fix typo in single core per container logic.

[thiagotnunes] test: disable SpannerIO.readChangeStream test

[noreply] Merge pull request #17164 from [BEAM-14140][Playground] Fix Deploy

[noreply] Merge pull request #16855 from [BEAM-13938][Playground] Increase test


------------------------------------------
[...truncated 17.38 KB...]
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648548882656792544/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/29 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648548882656792544/model
2022/03/29 10:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0329100245"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648548882656792544/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648548882656792544/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0329100245",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/29 10:14:44 Submitted job: 2022-03-29_03_14_43-11718944418751321351
2022/03/29 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-29_03_14_43-11718944418751321351?project=apache-beam-testing
2022/03/29 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-29_03_14_43-11718944418751321351
2022/03/29 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/29 10:15:14 Job still running ...
2022/03/29 10:15:44 Job still running ...
2022/03/29 10:16:14 Job still running ...
2022/03/29 10:16:44 Job still running ...
2022/03/29 10:17:14 Job still running ...
2022/03/29 10:17:45 Failed to execute job: job 2022-03-29_03_14_43-11718944418751321351 failed
panic: Failed to execute job: job 2022-03-29_03_14_43-11718944418751321351 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc000120000, 0x103e969, 0x19, 0xc0005e9e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/r2dxxxaiw6d32

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #463

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/463/display/redirect>

Changes:


------------------------------------------
[...truncated 17.38 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648462480286204239/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/28 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648462480286204239/model
2022/03/28 10:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0328100240"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648462480286204239/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648462480286204239/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0328100240",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/28 10:14:41 Submitted job: 2022-03-28_03_14_41-17701389204309214968
2022/03/28 10:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-28_03_14_41-17701389204309214968?project=apache-beam-testing
2022/03/28 10:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-28_03_14_41-17701389204309214968
2022/03/28 10:14:41 Job state: JOB_STATE_PENDING ...
2022/03/28 10:15:11 Job still running ...
2022/03/28 10:15:41 Job still running ...
2022/03/28 10:16:11 Job still running ...
2022/03/28 10:16:42 Job still running ...
2022/03/28 10:17:12 Job still running ...
2022/03/28 10:17:42 Job still running ...
2022/03/28 10:18:12 Failed to execute job: job 2022-03-28_03_14_41-17701389204309214968 failed
panic: Failed to execute job: job 2022-03-28_03_14_41-17701389204309214968 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc0007f3e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wjac2ar3slvoq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #462

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/462/display/redirect>

Changes:


------------------------------------------
[...truncated 17.38 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648376083307304210/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/27 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648376083307304210/model
2022/03/27 10:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0327100240"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648376083307304210/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648376083307304210/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0327100240",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/27 10:14:44 Submitted job: 2022-03-27_03_14_44-7806117293526872713
2022/03/27 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-27_03_14_44-7806117293526872713?project=apache-beam-testing
2022/03/27 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-27_03_14_44-7806117293526872713
2022/03/27 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/27 10:15:14 Job still running ...
2022/03/27 10:15:44 Job still running ...
2022/03/27 10:16:14 Job still running ...
2022/03/27 10:16:44 Job still running ...
2022/03/27 10:17:14 Job still running ...
2022/03/27 10:17:45 Job still running ...
2022/03/27 10:18:15 Failed to execute job: job 2022-03-27_03_14_44-7806117293526872713 failed
panic: Failed to execute job: job 2022-03-27_03_14_44-7806117293526872713 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc000198000, 0x103e969, 0x19, 0xc000451e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/q7mhu6m3ex3ak

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #461

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/461/display/redirect?page=changes>

Changes:

[ryanthompson591] iterable_input_value_types will now be an iterable, I don't anticipate

[marco.robles] [BEAM-8218] PulsarIO Connector

[benjamin.gonzalez] [BEAM-12572] Change examples jobs to run as cron jobs

[benjamin.gonzalez] [BEAM-12572] SpotlessApply

[Robert Bradshaw] [BEAM-14171] More explicit asserts in CoGBKResult.

[Robert Bradshaw] Add some comments.

[noreply] [BEAM-14160] Parse filesToStage in Java expansion service (#17167)

[chamikaramj] Mapped JOB_STATE_RESOURCE_CLEANING_UP to RESOURCE_CLEANING_UP in Python

[noreply] Explicitly import estimator from tensorflow (#17168)


------------------------------------------
[...truncated 17.41 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648289683334486179/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/26 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648289683334486179/model
2022/03/26 10:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0326100241"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648289683334486179/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648289683334486179/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0326100241",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/26 10:14:44 Submitted job: 2022-03-26_03_14_43-14265024178887560132
2022/03/26 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-26_03_14_43-14265024178887560132?project=apache-beam-testing
2022/03/26 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-26_03_14_43-14265024178887560132
2022/03/26 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/26 10:15:14 Job still running ...
2022/03/26 10:15:44 Job still running ...
2022/03/26 10:16:14 Job still running ...
2022/03/26 10:16:44 Job still running ...
2022/03/26 10:17:14 Job still running ...
2022/03/26 10:17:44 Job still running ...
2022/03/26 10:18:14 Failed to execute job: job 2022-03-26_03_14_43-14265024178887560132 failed
panic: Failed to execute job: job 2022-03-26_03_14_43-14265024178887560132 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc00074be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/p7cql2utmhlhu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #460

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/460/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-14139] Drop support for Flink 1.11.

[Kyle Weaver] [BEAM-14139] Remove obsolete reference to Flink 1.11.

[Kyle Weaver] [BEAM-14139] Update list of supported Flink versions.

[Kyle Weaver] [BEAM-14139] Update CHANGES.md

[noreply] [BEAM-14157] Don't call requestObserver.onNext on a closed windmill

[noreply] Minor: Make IOTypeHints a real NamedTuple (#17174)

[noreply] [BEAM-14172] Update tox.ini for pydocs (#17176)

[noreply] [BEAM-14065] Upgrade vendored bytebuddy to version 1.12.8 (#17028)


------------------------------------------
[...truncated 17.33 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648203283115158009/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/25 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648203283115158009/model
2022/03/25 10:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0325100242"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648203283115158009/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648203283115158009/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0325100242",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/25 10:14:46 Submitted job: 2022-03-25_03_14_43-15538005679407138967
2022/03/25 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-25_03_14_43-15538005679407138967?project=apache-beam-testing
2022/03/25 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-25_03_14_43-15538005679407138967
2022/03/25 10:14:46 Job state: JOB_STATE_PENDING ...
2022/03/25 10:15:16 Job still running ...
2022/03/25 10:15:46 Job still running ...
2022/03/25 10:16:16 Job still running ...
2022/03/25 10:16:46 Job still running ...
2022/03/25 10:17:16 Job still running ...
2022/03/25 10:17:46 Job still running ...
2022/03/25 10:18:16 Failed to execute job: job 2022-03-25_03_14_43-15538005679407138967 failed
panic: Failed to execute job: job 2022-03-25_03_14_43-15538005679407138967 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc0007e9e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rh3wbptxedenc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #459

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/459/display/redirect?page=changes>

Changes:

[bulat.safiullin] [BEAM-13976] [Website] update homepage

[bulat.safiullin] [BEAM-13976] [Website] update homepage, add logo

[bulat.safiullin] [BEAM-13976] [Website] update text

[bulat.safiullin] [BEAM-13976] [Website] Update Community landing page

[bulat.safiullin] [BEAM-13979] [Website] Update Community/Contact us page

[bulat.safiullin] [BEAM-13979] [Website] update title

[bulat.safiullin] [BEAM-13979] [Website] delete space

[bulat.safiullin] [BEAM-13979] [Website] add Beam Playground

[bulat.safiullin] [BEAM-13976] [Website] delete Beam Playground

[bulat.safiullin] [BEAM-13976] [Website] change navbar css links rules, delete links from

[bulat.safiullin] [BEAM-13977] [Website] delete available-contact-channels on mobile

[bulat.safiullin] [BEAM-13976] [Website] change padding size between the sections

[bulat.safiullin] [BEAM-13976] [Website] change title to capital letters

[bulat.safiullin] [BEAM-13976] [Website] change title

[bulat.safiullin] [BEAM-14040] [Website] create new page, add link

[bulat.safiullin] [BEAM-13977] [Website] change title

[bulat.safiullin] [BEAM-13979] [Website] change text

[bulat.safiullin] [BEAM-13976] [Website] change text

[bulat.safiullin] [BEAM-13977] [Website] change text, add capital letters

[bulat.safiullin] [BEAM-13976] [Website] add playground sass, change text-align

[bulat.safiullin] [BEAM-14040] [Website] add io connectors table

[bulat.safiullin] [BEAM-13976] [Website] add playground section, add empty line

[bulat.safiullin] [BEAM-14040] [Website] add overflow to css, add table content

[bulat.safiullin] [BEAM-14040] [Website] change ✘ for ✔, add license, add br

[bulat.safiullin] [BEAM-14040] [Website] add empty line

[bulat.safiullin] [BEAM-14040] [Website] change td

[bulat.safiullin] [BEAM-14041] [Website] update built io transforms

[bulat.safiullin] [BEAM-14041] [Website] move connectors from Miscellaneous to Database

[bulat.safiullin] [BEAM-14040] [Website] change links color

[danielamartinmtz] Updated metrics' CronJob API to use the latest batch version.

[bulat.safiullin] [BEAM-14041] [Website] change IO from go to java

[bulat.safiullin] [BEAM-14040] [Website] change links, change specific version to current

[danielamartinmtz] Updated cluster to test in metrics-upgrade-clone in BeamMetrics_Publish

[aydar.zaynutdinov] [BEAM-13976][Website]

[aydar.zaynutdinov] [BEAM-14040][Website]

[aydar.zaynutdinov] [BEAM-14041][Website]

[danielamartinmtz] Updated StateFulSet k8s obejct in cassandra-svc-statefulset.yaml file in

[danielamartinmtz] Updated documentation including cluster specs.

[noreply] Beam 13058 k8s apis upgrade - elasticsearch (#18)

[danielamartinmtz] Removed code used for testing.

[danielamartinmtz] Removed code used for testing in job_PostCommit_BeamMetrics_Publish

[noreply] Beam 13058 k8s apis upgrade - Adding Basic Auth details in documentation

[mmack] [BEAM-13232] Close clients properly in KinesisSource. Also use lazy init

[Pablo Estrada] [BEAM-14151] Excluding Spanner CDC tests from Dataflow V1 suite

[danielamartinmtz] Added comments in initContainers and remove unused code in elasticsearch

[noreply] [BEAM-14134] Optimize memory allocations for various core coders

[noreply] [BEAM-14129] Restructure PubsubLiteIO Read side to produce smaller

[noreply] [BEAM-12697] Add primitive field generation from IR to SBE extension

[noreply] [BEAM-13889] Add test cases to jsonx package (#17124)

[noreply] Remove unreachable code in container.go (#17166)

[noreply] Add ability to handle streaming input to AvroSchemaIOProvider (#17126)

[noreply] [BEAM-12898] Flink Load Tests failure- UncheckedExecutionException -

[Daniel Oliveira] Moving to 2.39.0-SNAPSHOT on master branch.


------------------------------------------
[...truncated 17.34 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648116888018524935/****\022@c4f40d200d5f4c551ee8225acadee9469e82191cdfceb3faf6f61b0f60b656cc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/24 10:14:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648116888018524935/model
2022/03/24 10:14:48 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0324100253"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648116888018524935/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648116888018524935/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0324100253",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/24 10:14:49 Submitted job: 2022-03-24_03_14_48-15114968722683274477
2022/03/24 10:14:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-24_03_14_48-15114968722683274477?project=apache-beam-testing
2022/03/24 10:14:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-24_03_14_48-15114968722683274477
2022/03/24 10:14:49 Job state: JOB_STATE_PENDING ...
2022/03/24 10:15:19 Job still running ...
2022/03/24 10:15:49 Job still running ...
2022/03/24 10:16:19 Job still running ...
2022/03/24 10:16:49 Job still running ...
2022/03/24 10:17:19 Job still running ...
2022/03/24 10:17:49 Job still running ...
2022/03/24 10:18:19 Failed to execute job: job 2022-03-24_03_14_48-15114968722683274477 failed
panic: Failed to execute job: job 2022-03-24_03_14_48-15114968722683274477 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc00019a000, 0x103e969, 0x19, 0xc0002e1e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/kyg3dvd7ohu4a

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #458

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/458/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14141] Set Interactive Beam to use the default Dataproc image

[noreply] BEAM-14115 - Update find criteria limited to _id (#17102)

[chamikaramj] Disable BigQueryIOStorageWriteIT for general Java post-commit

[noreply] Revert "[BEAM-14038] Auto-startup for Python expansion service.

[noreply] Minor: Bump timeout for Java PreCommit (#17157)

[noreply] [BEAM-14152] Disable flaky

[noreply] Fixing a small bug in TypedSchemaTransformTest that caused it to flake.

[noreply] [BEAM-14116] Catch MonitoringInfoMetricName null keys or values in the

[noreply] [BEAM-14129] Restructure SubscriptionPartitionLoader to use a manual SDF

[noreply] [BEAM-13015] Avoid repeated weighing of StateKey in

[noreply] Add option to add modules to JDK add-open (#17110)

[noreply] [BEAM-13015] Clarify ownership of the list for state caching across


------------------------------------------
[...truncated 17.38 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648030485044021082/****\022@7ea3e0c6699231341f291fa66bb7a1791deb03cc8757695c52877a86c251a286"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/23 10:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648030485044021082/model
2022/03/23 10:14:46 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0323100252"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648030485044021082/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648030485044021082/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0323100252",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/23 10:14:46 Submitted job: 2022-03-23_03_14_46-15541572225360521416
2022/03/23 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-23_03_14_46-15541572225360521416?project=apache-beam-testing
2022/03/23 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-23_03_14_46-15541572225360521416
2022/03/23 10:14:46 Job state: JOB_STATE_PENDING ...
2022/03/23 10:15:16 Job still running ...
2022/03/23 10:15:46 Job still running ...
2022/03/23 10:16:16 Job still running ...
2022/03/23 10:16:46 Job still running ...
2022/03/23 10:17:16 Job still running ...
2022/03/23 10:17:46 Job still running ...
2022/03/23 10:18:16 Failed to execute job: job 2022-03-23_03_14_46-15541572225360521416 failed
panic: Failed to execute job: job 2022-03-23_03_14_46-15541572225360521416 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc000120000, 0x103e969, 0x19, 0xc00059de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/3imakzpbncuw2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #457

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/457/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-14124] Add display data to BQ storage reads.

[mmack] [adhoc] Move aws IT tests to testing package according to best practices

[noreply] fixes static checks and go lint issues (#17138)

[Kyle Weaver] Don't print in task configuration.

[noreply] [BEAM-14136] Clean up staticcheck and linter warnings in the Go SDK

[noreply] Merge pull request #17063 from [BEAM-12164] Fix flaky tests

[noreply] Revert "[BEAM-14112] Avoid storing a generator in _CustomBigQuerySource

[Kyle Weaver] [BEAM-4106] Remove filesToStage from Flink pipeline option list.

[noreply] [BEAM-14071] Enabling Flink on Dataproc for Interactive Beam (#17044)

[noreply] Minor: Bypass schema registry in schemas_test.py (#17108)


------------------------------------------
[...truncated 17.47 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647944080934972497/****\022@7ea3e0c6699231341f291fa66bb7a1791deb03cc8757695c52877a86c251a286"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/22 10:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647944080934972497/model
2022/03/22 10:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0322100236"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647944080934972497/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647944080934972497/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0322100236",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/22 10:14:42 Submitted job: 2022-03-22_03_14_41-18425130805982316627
2022/03/22 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-22_03_14_41-18425130805982316627?project=apache-beam-testing
2022/03/22 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-22_03_14_41-18425130805982316627
2022/03/22 10:14:42 Job state: JOB_STATE_PENDING ...
2022/03/22 10:15:12 Job still running ...
2022/03/22 10:15:42 Job still running ...
2022/03/22 10:16:12 Job still running ...
2022/03/22 10:16:42 Job still running ...
2022/03/22 10:17:12 Job still running ...
2022/03/22 10:17:42 Job still running ...
2022/03/22 10:18:12 Job still running ...
2022/03/22 10:18:42 Job still running ...
2022/03/22 10:19:12 Job still running ...
2022/03/22 10:19:42 Job still running ...
2022/03/22 10:20:12 Failed to execute job: job 2022-03-22_03_14_41-18425130805982316627 failed
panic: Failed to execute job: job 2022-03-22_03_14_41-18425130805982316627 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc00040de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/pe77yfsorjt34

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #456

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/456/display/redirect>

Changes:


------------------------------------------
[...truncated 17.32 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647857680764366537/****\022@b99141a92c2add70ddbe77d41dc70d55cdb80e82671b4a517490ac16b3227be2"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/21 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647857680764366537/model
2022/03/21 10:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0321100243"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647857680764366537/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647857680764366537/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0321100243",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/21 10:14:42 Submitted job: 2022-03-21_03_14_42-1593659086409336892
2022/03/21 10:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-21_03_14_42-1593659086409336892?project=apache-beam-testing
2022/03/21 10:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-21_03_14_42-1593659086409336892
2022/03/21 10:14:42 Job state: JOB_STATE_PENDING ...
2022/03/21 10:15:12 Job still running ...
2022/03/21 10:15:42 Job still running ...
2022/03/21 10:16:12 Job still running ...
2022/03/21 10:16:42 Job still running ...
2022/03/21 10:17:12 Job still running ...
2022/03/21 10:17:42 Job still running ...
2022/03/21 10:18:13 Failed to execute job: job 2022-03-21_03_14_42-1593659086409336892 failed
panic: Failed to execute job: job 2022-03-21_03_14_42-1593659086409336892 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc0000480c0, 0x103e969, 0x19, 0xc000405e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jhav4tznilono

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #455

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/455/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14122] Upgrade pip-licenses dependency (#17132)


------------------------------------------
[...truncated 17.32 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647771281937535505/****\022@b99141a92c2add70ddbe77d41dc70d55cdb80e82671b4a517490ac16b3227be2"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/20 10:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647771281937535505/model
2022/03/20 10:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0320100234"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647771281937535505/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647771281937535505/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0320100234",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/20 10:14:43 Submitted job: 2022-03-20_03_14_42-15900324607098333908
2022/03/20 10:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-20_03_14_42-15900324607098333908?project=apache-beam-testing
2022/03/20 10:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-20_03_14_42-15900324607098333908
2022/03/20 10:14:43 Job state: JOB_STATE_PENDING ...
2022/03/20 10:15:13 Job still running ...
2022/03/20 10:15:43 Job still running ...
2022/03/20 10:16:13 Job still running ...
2022/03/20 10:16:43 Job still running ...
2022/03/20 10:17:13 Job still running ...
2022/03/20 10:17:43 Job still running ...
2022/03/20 10:18:14 Failed to execute job: job 2022-03-20_03_14_42-15900324607098333908 failed
panic: Failed to execute job: job 2022-03-20_03_14_42-15900324607098333908 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc000120000, 0x103e969, 0x19, 0xc00050fe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/msqoklesmtugk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #454

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/454/display/redirect?page=changes>

Changes:

[Kiley Sok] Add Java 17 Nexmark metrics to Grafana

[yiru] .

[yiru] .

[yiru] .

[yiru] format fix

[yiru] .

[yiru] make DoFn into a separate class

[yiru] .

[yiru] fix setting

[mmack] [adhoc] Minor cleanup for aws2 tests

[mmack] [BEAM-14125] Update website IO matrix to recommend aws2 IOs

[noreply] [BEAM-14128] Eliminating quadratic behavior of

[noreply] [BEAM-13972] Add RunInference interface (#16917)

[noreply] Merge pull request #17116 from [BEAM-12164] Remove change_stream in

[yiru] fix checkstyle

[yiru] spotlessapply

[noreply] Deprecate tags.go (#17025)

[noreply] [BEAM-12753] and [BEAM-12815] Fix Flink Integration Tests (#17067)

[noreply] Merge pull request #16895 from [BEAM-13882][Playground] More tests for

[noreply] [BEAM-13925] Add weekly automation to update our reviewer config

[noreply] Merge pull request #17076 from Beam 14082 update payground for mobile

[noreply] [BEAM-13925] Assign committers in the scheduled action (#17062)

[noreply] Pin setup-gcloud to v0 instead of master (#17123)

[noreply] [BEAM-3304] documentation for PaneInfo in BPG (#17047)

[noreply] Merge pull request #17016 from [BEAM-14049][Playground] Add new API

[noreply] Merge pull request #17077 from [BEAM-14078] [Website] change link

[noreply] Merge pull request #17085 from [BEAM-14077] [Website] add beam

[noreply] Update Changes.md w/Go pipeline pre-process fix.

[noreply] [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088)

[noreply] Merge pull request #17023 from [BEAM-12164]: Remove child partition


------------------------------------------
[...truncated 17.38 KB...]
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647684886956516790/****\022@b99141a92c2add70ddbe77d41dc70d55cdb80e82671b4a517490ac16b3227be2"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/19 10:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647684886956516790/model
2022/03/19 10:14:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0319100246"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647684886956516790/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647684886956516790/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0319100246",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/19 10:14:48 Submitted job: 2022-03-19_03_14_47-190635904394226332
2022/03/19 10:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-19_03_14_47-190635904394226332?project=apache-beam-testing
2022/03/19 10:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-19_03_14_47-190635904394226332
2022/03/19 10:14:48 Job state: JOB_STATE_PENDING ...
2022/03/19 10:15:18 Job state: JOB_STATE_PENDING ...
2022/03/19 10:15:48 Job state: JOB_STATE_PENDING ...
2022/03/19 10:16:18 Job still running ...
2022/03/19 10:16:48 Job still running ...
2022/03/19 10:17:18 Job still running ...
2022/03/19 10:17:48 Job still running ...
2022/03/19 10:18:18 Job still running ...
2022/03/19 10:18:48 Job still running ...
2022/03/19 10:19:18 Job still running ...
2022/03/19 10:19:48 Failed to execute job: job 2022-03-19_03_14_47-190635904394226332 failed
panic: Failed to execute job: job 2022-03-19_03_14_47-190635904394226332 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11515e8, 0xc000198000, 0x103e969, 0x19, 0xc000355e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 24s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bhz5caiplf7kg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #453

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/453/display/redirect?page=changes>

Changes:

[Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage.

[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner

[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)

[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,

[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.

[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource (#17100)

[noreply] Populate environment capabilities in v1beta3 protos. (#17042)

[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in BQ IO.

[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on Dataflow,

[noreply] [BEAM-14038] Auto-startup for Python expansion service. (#17035)

[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.

[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)

[noreply] Merge pull request #16977 from [BEAM-12164]  Added integration test for


------------------------------------------
[...truncated 17.42 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647598488457088635/****\022@63adb1ccf36a82905b2586a432719f709f0da7be4aa85336991861fcf564f950"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/18 10:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647598488457088635/model
2022/03/18 10:14:49 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0318100240"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647598488457088635/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647598488457088635/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0318100240",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/18 10:14:49 Submitted job: 2022-03-18_03_14_49-1930818338769799004
2022/03/18 10:14:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-18_03_14_49-1930818338769799004?project=apache-beam-testing
2022/03/18 10:14:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-18_03_14_49-1930818338769799004
2022/03/18 10:14:49 Job state: JOB_STATE_PENDING ...
2022/03/18 10:15:19 Job still running ...
2022/03/18 10:15:49 Job still running ...
2022/03/18 10:16:19 Job still running ...
2022/03/18 10:16:49 Job still running ...
2022/03/18 10:17:19 Job still running ...
2022/03/18 10:17:50 Job still running ...
2022/03/18 10:18:20 Failed to execute job: job 2022-03-18_03_14_49-1930818338769799004 failed
panic: Failed to execute job: job 2022-03-18_03_14_49-1930818338769799004 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151608, 0xc000120000, 0x103e969, 0x19, 0xc00034de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 56s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/33g3j54bi7pmg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #452

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/452/display/redirect?page=changes>

Changes:

[noreply] Mapped JOB_STATE_RESOURCE_CLEANING_UP to State.RUNNING.

[ryanthompson591] fixed typo in typehints

[zyichi] Remove unused prebuild_sdk_container_base_iamge option from validate

[hengfeng] feat: add more custom metrics

[noreply] [BEAM-14103][Playgrounf][Bugfix] Fix google analytics id (#17092)

[noreply] Minor: Make ScopedReadStateSupplier final (#16992)

[noreply] [BEAM-14113] Improve SamzaJobServerDriver extensibility (#17099)

[noreply] [BEAM-14116] Chunk commit requests dynamically (#17004)

[noreply] Merge pull request #17079 from [BEAM-13660] Add types and queries in

[noreply] [BEAM-13888] Add unit testing to ioutilx (#17058)

[noreply] Merge pull request #16822 from [BEAM-13841][Playground] Add Application

[noreply] Minor: Make serializableCoder warning gramatically correct english

[noreply] [BEAM-14091] Fixing Interactive Beam show/collect for remote runners


------------------------------------------
[...truncated 17.39 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647512084636689391/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/17 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647512084636689391/model
2022/03/17 10:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0317100239"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647512084636689391/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647512084636689391/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0317100239",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/17 10:14:45 Submitted job: 2022-03-17_03_14_45-10407087370645164023
2022/03/17 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-17_03_14_45-10407087370645164023?project=apache-beam-testing
2022/03/17 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-17_03_14_45-10407087370645164023
2022/03/17 10:14:45 Job state: JOB_STATE_PENDING ...
2022/03/17 10:15:15 Job still running ...
2022/03/17 10:15:46 Job still running ...
2022/03/17 10:16:16 Job still running ...
2022/03/17 10:16:46 Job still running ...
2022/03/17 10:17:16 Job still running ...
2022/03/17 10:17:46 Job still running ...
2022/03/17 10:18:16 Failed to execute job: job 2022-03-17_03_14_45-10407087370645164023 failed
panic: Failed to execute job: job 2022-03-17_03_14_45-10407087370645164023 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc000120000, 0x103e889, 0x19, 0xc00040de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vu2mzx5vfjxdc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #451

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/451/display/redirect?page=changes>

Changes:

[Chamikara Madhusanka Jayalath] Updates x-lang release validation to use staged jars

[dhuntsperger] documented maven-to-gradle conversion for Dataflow; refactored java

[dhuntsperger] adding a list of example pipelines

[dhuntsperger] removing unnecessary `ls` command from maven project generation

[mmack] [BEAM-13175] Add KinesisIO.write for AWS SDK v2.

[dhuntsperger] fixing filename formatting in response to feedback

[dhuntsperger] adding extra step emphasizing runner setupt

[dhuntsperger] reorganized instructions to emphasize setup steps for runners

[mmack] [BEAM-13175] Document changes to IOs in amazon-web-services2 for AWS

[noreply] [BEAM-13767] Move a bunch of python tasks to use gradle configuration…

[noreply] Merge pull request #17052 from [BEAM-13818] [SnowflakeIO] Add support

[noreply] Adding pydoc for StateHandler (#17091)

[noreply] BEAM-3165 Bypass split if numSplit is zero (#17084)


------------------------------------------
[...truncated 17.39 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647425683216495624/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/16 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647425683216495624/model
2022/03/16 10:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0316100245"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647425683216495624/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647425683216495624/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0316100245",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/16 10:14:46 Submitted job: 2022-03-16_03_14_43-780210040161135301
2022/03/16 10:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-16_03_14_43-780210040161135301?project=apache-beam-testing
2022/03/16 10:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-16_03_14_43-780210040161135301
2022/03/16 10:14:46 Job state: JOB_STATE_PENDING ...
2022/03/16 10:15:16 Job still running ...
2022/03/16 10:15:46 Job still running ...
2022/03/16 10:16:16 Job still running ...
2022/03/16 10:16:46 Job still running ...
2022/03/16 10:17:16 Job still running ...
2022/03/16 10:17:46 Job still running ...
2022/03/16 10:18:16 Failed to execute job: job 2022-03-16_03_14_43-780210040161135301 failed
panic: Failed to execute job: job 2022-03-16_03_14_43-780210040161135301 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc000120000, 0x103e889, 0x19, 0xc0005d5e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6bb43rpxymf3q

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #450

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/450/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test

[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test

[benjamin.gonzalez] [BEAM-12572] Add java examples tests

[benjamin.gonzalez] [BEAM-12572] Change tests collected by runner

[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions, skip tests for specific runners

[benjamin.gonzalez] [BEAM-12572] Skip failing tests

[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warnings

[benjamin.gonzalez] [BEAM-12572] Skip tfidf tests on direct runner

[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions

[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warning

[benjamin.gonzalez] [BEAM-12572] Enable test with Pipeline serialization error fixed, link

[benjamin.gonzalez] [BEAM-12572] Sickbay TfIdf test for DirectRunner

[benjamin.gonzalez] [BEAM-12572] Refactor naming for BigQueryClient

[mmack] [adhoc] Update owners for aws modules

[noreply] [BEAM-14051] Add a warning to gradle.properties that many Beam modules

[noreply] Merge pull request #17000 from [BEAM-13881] [Playground] Increase test

[noreply] Add deterministic dict coding via key sorting. (#17037)

[noreply] Merge pull request #17054 from [BEAM-14075] [SnowflakeIO] Change a


------------------------------------------
[...truncated 17.37 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647339284468111973/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/15 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647339284468111973/model
2022/03/15 10:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0315100244"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647339284468111973/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647339284468111973/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0315100244",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/15 10:14:45 Submitted job: 2022-03-15_03_14_45-9097755084072332160
2022/03/15 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-15_03_14_45-9097755084072332160?project=apache-beam-testing
2022/03/15 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-15_03_14_45-9097755084072332160
2022/03/15 10:14:45 Job state: JOB_STATE_PENDING ...
2022/03/15 10:15:15 Job still running ...
2022/03/15 10:15:45 Job still running ...
2022/03/15 10:16:15 Job still running ...
2022/03/15 10:16:45 Job still running ...
2022/03/15 10:17:16 Job still running ...
2022/03/15 10:17:46 Job still running ...
2022/03/15 10:18:16 Failed to execute job: job 2022-03-15_03_14_45-9097755084072332160 failed
panic: Failed to execute job: job 2022-03-15_03_14_45-9097755084072332160 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc0000480c0, 0x103e889, 0x19, 0xc0008abe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ro2w5p35ciis2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #449

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/449/display/redirect>

Changes:


------------------------------------------
[...truncated 17.37 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647252883530348502/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/14 10:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647252883530348502/model
2022/03/14 10:14:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0314100232"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647252883530348502/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647252883530348502/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0314100232",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/14 10:14:44 Submitted job: 2022-03-14_03_14_44-7176373392722179813
2022/03/14 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-14_03_14_44-7176373392722179813?project=apache-beam-testing
2022/03/14 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-14_03_14_44-7176373392722179813
2022/03/14 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/14 10:15:14 Job still running ...
2022/03/14 10:15:44 Job still running ...
2022/03/14 10:16:14 Job still running ...
2022/03/14 10:16:45 Job still running ...
2022/03/14 10:17:15 Job still running ...
2022/03/14 10:17:45 Job still running ...
2022/03/14 10:18:15 Job still running ...
2022/03/14 10:18:45 Failed to execute job: job 2022-03-14_03_14_44-7176373392722179813 failed
panic: Failed to execute job: job 2022-03-14_03_14_44-7176373392722179813 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc000120000, 0x103e889, 0x19, 0xc0001dbe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bpw3bmyevmlps

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #448

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/448/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14072] [BEAM-13993] [BEAM-10039] Import beam plugins before


------------------------------------------
[...truncated 17.36 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647166483220988423/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/13 10:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647166483220988423/model
2022/03/13 10:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0313100239"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647166483220988423/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647166483220988423/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0313100239",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/13 10:14:44 Submitted job: 2022-03-13_03_14_43-3729027099174062322
2022/03/13 10:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-13_03_14_43-3729027099174062322?project=apache-beam-testing
2022/03/13 10:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-13_03_14_43-3729027099174062322
2022/03/13 10:14:44 Job state: JOB_STATE_PENDING ...
2022/03/13 10:15:14 Job still running ...
2022/03/13 10:15:44 Job still running ...
2022/03/13 10:16:14 Job still running ...
2022/03/13 10:16:44 Job still running ...
2022/03/13 10:17:15 Job still running ...
2022/03/13 10:17:45 Job still running ...
2022/03/13 10:18:15 Failed to execute job: job 2022-03-13_03_14_43-3729027099174062322 failed
panic: Failed to execute job: job 2022-03-13_03_14_43-3729027099174062322 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc00018a000, 0x103e889, 0x19, 0xc0004cde00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jl7r5s5ywdtmo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #447

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/447/display/redirect?page=changes>

Changes:

[Ismaël Mejía] [BEAM-13981] Remove Spark Runner specific code for event logging

[vitaly.terentyev] [BEAM-2766] Support null key/values in HadoopFormatIO

[vitaly.terentyev] [BEAM-2766] Fix checkstyle


------------------------------------------
[...truncated 17.35 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647080084372174529/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/12 10:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647080084372174529/model
2022/03/12 10:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0312100230"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647080084372174529/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647080084372174529/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0312100230",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/12 10:14:45 Submitted job: 2022-03-12_02_14_45-7764437779426937775
2022/03/12 10:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-12_02_14_45-7764437779426937775?project=apache-beam-testing
2022/03/12 10:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-12_02_14_45-7764437779426937775
2022/03/12 10:14:45 Job state: JOB_STATE_PENDING ...
2022/03/12 10:15:15 Job still running ...
2022/03/12 10:15:45 Job still running ...
2022/03/12 10:16:15 Job still running ...
2022/03/12 10:16:45 Job still running ...
2022/03/12 10:17:15 Job still running ...
2022/03/12 10:17:45 Job still running ...
2022/03/12 10:18:16 Failed to execute job: job 2022-03-12_02_14_45-7764437779426937775 failed
panic: Failed to execute job: job 2022-03-12_02_14_45-7764437779426937775 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc00019a000, 0x103e889, 0x19, 0xc000493e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rpjpfyy342iii

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_GBK_Dataflow_Batch #446

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/446/display/redirect?page=changes>

Changes:

[ihr] [BEAM-13923] Fix the answers placeholders locations in the Java katas

[jakub.kukul] [BEAM-14039] Propagate ignore_unknown_columns parameter.

[stranniknm] [BEAM-14079] playground - improve accessibility

[noreply] [BEAM-13925] Find and address prs that havent been reviewed in a week

[noreply] Fix import path

[noreply] [BEAM-13925] Fix one more import path

[noreply] Add a StatefulDoFn test that sets event time timer within allowed

[noreply] Merge pull request #17056 from [BEAM-14076] [SnowflakeIO] Add support


------------------------------------------
[...truncated 17.36 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646993686835923623/****\022@cc31d7b4e20b75e019774efa4fac7ffd36cfffe90bc12eb87d96700ef4e69ba4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/11 10:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646993686835923623/model
2022/03/11 10:14:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-gbk-1-0311100229"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "iterations",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_gbk_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/group_by_key"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646993686835923623/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_gbk_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "iterations": "1",
          "****_binary": "linux_amd64/group_by_key"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646993686835923623/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-gbk-1-0311100229",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/11 10:14:48 Submitted job: 2022-03-11_02_14_47-11153576364131134789
2022/03/11 10:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-11_02_14_47-11153576364131134789?project=apache-beam-testing
2022/03/11 10:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-11_02_14_47-11153576364131134789
2022/03/11 10:14:48 Job state: JOB_STATE_PENDING ...
2022/03/11 10:15:18 Job still running ...
2022/03/11 10:15:48 Job still running ...
2022/03/11 10:16:18 Job still running ...
2022/03/11 10:16:48 Job still running ...
2022/03/11 10:17:18 Job still running ...
2022/03/11 10:17:48 Job still running ...
2022/03/11 10:18:18 Failed to execute job: job 2022-03-11_02_14_47-11153576364131134789 failed
panic: Failed to execute job: job 2022-03-11_02_14_47-11153576364131134789 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151528, 0xc000198000, 0x103e889, 0x19, 0xc0002e3e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/group_by_key/group_by_key.go>:82 +0x418

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_GBK_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5zmbppxwqvdoy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org