You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/01/25 08:56:14 UTC

Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #402

See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/402/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-13716] Clear before creating a new virtual environment in

[mmack] [BEAM-13653] Make SnsIO.write topicArn optional. If provided, validate

[noreply] [BEAM-10897] Update the fastavro lower bound due to an issue on Windows

[noreply] [BEAM-13605] Update pandas_doctests_test denylists in preparation for

[noreply] Merge pull request #16538 from [BEAM-13676][Playground][Bugfix]Build Of

[noreply] Merge pull request #16582 from [BEAM-13711] [Playground] [Bugfix] Add

[noreply] Merge pull request #16515 from [BEAM-13636] [Playground] Checking the

[ningkang0957] [BEAM-13275] Removed the explicit selenium dependency from setup

[noreply] [BEAM-10206] Deprecate unused shallow cloning functions (#16600)

[noreply] Bump Dataflow container versions (#16602)

[noreply] Improved multi-language pipelines section of the programming guide


------------------------------------------
[...truncated 21.37 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/25 08:52:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643100760232590571/model
2022/01/25 08:52:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0125065331"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643100760232590571/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643100760232590571/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0125065331",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/25 08:52:41 Submitted job: 2022-01-25_00_52_40-16083477220408519413
2022/01/25 08:52:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-25_00_52_40-16083477220408519413?project=apache-beam-testing
2022/01/25 08:52:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-25_00_52_40-16083477220408519413
2022/01/25 08:52:41 Job state: JOB_STATE_PENDING ...
2022/01/25 08:53:11 Job still running ...
2022/01/25 08:53:41 Job still running ...
2022/01/25 08:54:11 Job still running ...
2022/01/25 08:54:41 Job still running ...
2022/01/25 08:55:11 Job still running ...
2022/01/25 08:55:41 Job still running ...
2022/01/25 08:56:12 Failed to execute job: job 2022-01-25_00_52_40-16083477220408519413 failed
panic: Failed to execute job: job 2022-01-25_00_52_40-16083477220408519413 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11509e8, 0xc0000480b0, 0x103df1a, 0x19, 0xc00041be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/y33t5rluh6k54

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_LoadTests_Go_Combine_Dataflow_Batch #502

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/502/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #501

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/501/display/redirect?page=changes>

Changes:

[zyichi] Move master readme.md to 2.40.0

[noreply] [BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink


------------------------------------------
[...truncated 21.38 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651770349909442211/****\022@0081ea400a319ef515ebebe52f537a02d55b339db25a15acefefe2b9ea72d97e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 17:05:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651770349909442211/model
2022/05/05 17:05:50 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0505150156"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.40.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770349909442211/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.40.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770349909442211/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.40.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0505150156",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/05 17:05:51 Submitted job: 2022-05-05_10_05_50-11065201790489373240
2022/05/05 17:05:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_10_05_50-11065201790489373240?project=apache-beam-testing
2022/05/05 17:05:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_10_05_50-11065201790489373240
2022/05/05 17:05:51 Job state: JOB_STATE_PENDING ...
2022/05/05 17:06:21 Job still running ...
2022/05/05 17:06:51 Job still running ...
2022/05/05 17:07:21 Job still running ...
2022/05/05 17:07:51 Job still running ...
2022/05/05 17:08:21 Job still running ...
2022/05/05 17:08:51 Job still running ...
2022/05/05 17:09:21 Job still running ...
2022/05/05 17:09:51 Job still running ...
2022/05/05 17:10:21 Job still running ...
2022/05/05 17:10:52 Failed to execute job: job 2022-05-05_10_05_50-11065201790489373240 failed
panic: Failed to execute job: job 2022-05-05_10_05_50-11065201790489373240 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x123cbc8, 0xc0000480c0, 0x111835f, 0x19, 0xc0003e9e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/nleeeig7e3jiq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #500

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/500/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-9245] Unable to pull datatore Entity which contains dict

[bulat.safiullin] [BEAM-14382] [Website] add banner container for with css, images, html

[Jan Lukavský] [BEAM-14196] add test verifying output watermark propagation in bundle

[Jan Lukavský] [BEAM-14196] Fix FlinkRunner mid-bundle output watermark handling

[nielm] [BEAM-14405] Fix NPE when ProjectID is not specified in a template

[bulat.safiullin] [BEAM-14382] change mobile banner img, add padding to banner section

[ahmedabualsaud] fix test decotrator typo

[noreply] Merge pull request #17440 from [BEAM-14329] Enable exponential backoff

[noreply] [BEAM-11104] Fix output forwarding issue for ProcessContinuations

[noreply] re-add testing package to pydoc (#17524)

[Heejong Lee] add test

[noreply] [BEAM-14250] Amended the workaround (#17531)

[noreply] [BEAM-11104] Fix broken split result validation (#17546)

[noreply] Fixed a SQL and screenshots in the Beam SQL blog (#17545)

[noreply] Merge pull request #17417: [BEAM-14388] Address some performance

[noreply] [BEAM-14386] [Flink] Support for scala 2.12 (#17512)

[noreply] [BEAM-14294] Worker changes to support trivial Batched DoFns (#17384)

[zyichi] Moving to 2.40.0-SNAPSHOT on master branch.

[noreply] [BEAM-14048] [CdapIO] Add ConfigWrapper for building CDAP PluginConfigs


------------------------------------------
[...truncated 21.13 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651740758454171868/****\022@1fb1fec55fc17434e0e90f84bbfb209bff5e7b4dbd56460562576a8c59290b43"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 08:52:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651740758454171868/model
2022/05/05 08:52:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0505065332"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.40.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651740758454171868/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.40.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651740758454171868/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.40.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0505065332",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/05 08:52:39 Submitted job: 2022-05-05_01_52_39-11494435673621891189
2022/05/05 08:52:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_01_52_39-11494435673621891189?project=apache-beam-testing
2022/05/05 08:52:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_01_52_39-11494435673621891189
2022/05/05 08:52:39 Job state: JOB_STATE_PENDING ...
2022/05/05 08:53:09 Job still running ...
2022/05/05 08:53:40 Job still running ...
2022/05/05 08:54:10 Job still running ...
2022/05/05 08:54:40 Job still running ...
2022/05/05 08:55:10 Job still running ...
2022/05/05 08:55:40 Job still running ...
2022/05/05 08:56:10 Job still running ...
2022/05/05 08:56:40 Job still running ...
2022/05/05 08:57:10 Job still running ...
2022/05/05 08:57:40 Failed to execute job: job 2022-05-05_01_52_39-11494435673621891189 failed
panic: Failed to execute job: job 2022-05-05_01_52_39-11494435673621891189 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x123cb48, 0xc00012e000, 0x11182df, 0x19, 0xc000407e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/w6xozbsu6wxxu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #499

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/499/display/redirect?page=changes>

Changes:

[noreply] fix: JDBC config schema fields order

[Brian Hulette] Revert "Merge pull request #17255 from kileys/test-revert"

[Brian Hulette] BEAM-14231: bypass schema cache for

[noreply] [BEAM-13657] Follow up update version warning in __init__ (#17493)

[noreply] Merge pull request #17431 from [BEAM-14273] Add integration tests for BQ

[noreply] Merge pull request #17205 from [BEAM-14145] [Website] add carousel to

[noreply] [BEAM-14064] fix es io windowing (#17112)

[noreply] [BEAM-13670] Upgraded ipython from v7 to v8 (#17529)

[noreply] [BEAM-11104] Enable ProcessContinuation return values, add unit test

[Robert Bradshaw] [BEAM-14403] Allow Prime to be used with legacy workers.

[noreply] [BEAM-11106] Support drain in Go SDK (#17432)

[noreply] add __Init__ to inference. (#17514)


------------------------------------------
[...truncated 21.15 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651654373809374076/****\022@947186467ffd3809e51f9e1c9b168a6982df6f778f50ce9b0bd73dedb1c82687"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/04 08:52:54 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651654373809374076/model
2022/05/04 08:52:54 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0428110815"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651654373809374076/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651654373809374076/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0428110815",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/04 08:52:55 Submitted job: 2022-05-04_01_52_54-6478567116996340475
2022/05/04 08:52:55 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-04_01_52_54-6478567116996340475?project=apache-beam-testing
2022/05/04 08:52:55 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-04_01_52_54-6478567116996340475
2022/05/04 08:52:55 Job state: JOB_STATE_PENDING ...
2022/05/04 08:53:25 Job still running ...
2022/05/04 08:53:55 Job still running ...
2022/05/04 08:54:25 Job still running ...
2022/05/04 08:54:55 Job still running ...
2022/05/04 08:55:25 Job still running ...
2022/05/04 08:55:55 Job still running ...
2022/05/04 08:56:26 Job still running ...
2022/05/04 08:56:56 Job still running ...
2022/05/04 08:57:26 Job still running ...
2022/05/04 08:57:56 Failed to execute job: job 2022-05-04_01_52_54-6478567116996340475 failed
panic: Failed to execute job: job 2022-05-04_01_52_54-6478567116996340475 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x123cb48, 0xc0001a8000, 0x11182df, 0x19, 0xc0003c9e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 24s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fngfp4qaex6jq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #498

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/498/display/redirect?page=changes>

Changes:

[yathu] [BEAM-14375] Fix Java Wordcount Dataflow postcommit

[Robert Bradshaw] Allow arithmetic between deferred scalars.

[noreply] [BEAM-14390] Set user-agent when pulling licenses to avoid 403s (#17521)

[noreply] [BEAM-8688] Upgrade GCSIO to 2.2.6 (#17486)

[noreply] [BEAM-14253] patch SubscriptionPartitionLoader to work around a dataflow

[noreply] Add website link log to notify user of pre-build workflow. (#17498)

[noreply] [BEAM-11105] Add timestamp observing watermark estimation (#17476)

[noreply] Merge pull request #17487 from Adding user-agent to GCS client in Python

[noreply] [BEAM-10265] Display error message if trying to infer recursive schema

[noreply] [BEAM-12575] Upgraded ipykernel from v5 to v6 (#17526)

[noreply] [BEAM-11105] Add docs + CHANGES.md entry for Go Watermark Estimation

[noreply] Merge pull request #17380 from [BEAM-14314][BEAM-9532] Add last_updated


------------------------------------------
[...truncated 21.15 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651567966729523461/****\022@55f4b708948d48f06327b3260c0461f93197480c6c19654525b23bde8ad563e7"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/03 08:52:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651567966729523461/model
2022/05/03 08:52:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0428110815"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651567966729523461/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651567966729523461/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0428110815",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/03 08:52:48 Submitted job: 2022-05-03_01_52_47-3589103091556404089
2022/05/03 08:52:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-03_01_52_47-3589103091556404089?project=apache-beam-testing
2022/05/03 08:52:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-03_01_52_47-3589103091556404089
2022/05/03 08:52:48 Job state: JOB_STATE_PENDING ...
2022/05/03 08:53:18 Job still running ...
2022/05/03 08:53:48 Job still running ...
2022/05/03 08:54:18 Job still running ...
2022/05/03 08:54:48 Job still running ...
2022/05/03 08:55:18 Job still running ...
2022/05/03 08:55:48 Failed to execute job: job 2022-05-03_01_52_47-3589103091556404089 failed
panic: Failed to execute job: job 2022-05-03_01_52_47-3589103091556404089 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x123a108, 0xc0000480c0, 0x1115dcc, 0x19, 0xc0003e7e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wvx7smrtir7lk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #497

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/497/display/redirect?page=changes>

Changes:

[noreply] [BEAM-11105] Add manual watermark estimation (#17475)


------------------------------------------
[...truncated 21.08 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651481558180256391/****\022@51c5147626b25c22a22a9aca732ec5a4157eec201ec41a0ec04e6c5c78124378"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/02 08:52:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651481558180256391/model
2022/05/02 08:52:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0428110815"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651481558180256391/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651481558180256391/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0428110815",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/02 08:52:41 Submitted job: 2022-05-02_01_52_38-15671200405565444122
2022/05/02 08:52:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-02_01_52_38-15671200405565444122?project=apache-beam-testing
2022/05/02 08:52:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-02_01_52_38-15671200405565444122
2022/05/02 08:52:42 Job state: JOB_STATE_PENDING ...
2022/05/02 08:53:12 Job still running ...
2022/05/02 08:53:42 Job still running ...
2022/05/02 08:54:12 Job still running ...
2022/05/02 08:54:42 Job still running ...
2022/05/02 08:55:12 Job still running ...
2022/05/02 08:55:42 Job still running ...
2022/05/02 08:56:12 Job still running ...
2022/05/02 08:56:42 Job still running ...
2022/05/02 08:57:12 Job still running ...
2022/05/02 08:57:42 Failed to execute job: job 2022-05-02_01_52_38-15671200405565444122 failed
panic: Failed to execute job: job 2022-05-02_01_52_38-15671200405565444122 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1216948, 0xc00012e000, 0x10f2a49, 0x19, 0xc00036de78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4r2pjxjkw3wrs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #496

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/496/display/redirect?page=changes>

Changes:

[noreply] Revert "Improvement to Seed job configuration to launch against PRs

[ilion.beyst] Minor: fix typo

[noreply] Merge pull request #17422 from [BEAM-14344]: remove tracing from


------------------------------------------
[...truncated 21.12 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651395149152203042/****\022@83954ff4d7bcce2690d4a673e1350fbcfc4c0fe4b786057fb4b26fa0ffbd1f36"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/01 08:52:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651395149152203042/model
2022/05/01 08:52:29 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0428110815"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651395149152203042/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651395149152203042/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0428110815",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/01 08:52:30 Submitted job: 2022-05-01_01_52_29-17798655146260516842
2022/05/01 08:52:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-01_01_52_29-17798655146260516842?project=apache-beam-testing
2022/05/01 08:52:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-01_01_52_29-17798655146260516842
2022/05/01 08:52:30 Job state: JOB_STATE_PENDING ...
2022/05/01 08:53:00 Job still running ...
2022/05/01 08:53:30 Job still running ...
2022/05/01 08:54:00 Job still running ...
2022/05/01 08:54:30 Job still running ...
2022/05/01 08:55:00 Job still running ...
2022/05/01 08:55:30 Failed to execute job: job 2022-05-01_01_52_29-17798655146260516842 failed
panic: Failed to execute job: job 2022-05-01_01_52_29-17798655146260516842 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1215648, 0xc00012e000, 0x10f1977, 0x19, 0xc00044be78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 6s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/w55xbxhzj6jag

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #495

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/495/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Add element weighting parameter to BatchElements.

[Robert Bradshaw] Clearer test.

[noreply] Revert "Merge pull request #17260 from [BEAM-13229] [Website] bug side

[noreply] [BEAM-14351] Fix the template and move the announcement to the next

[noreply] [BEAM-14001] Add missing test cases to existing suites in exec package

[noreply] [BEAM-14243] Add staticcheck to Github Actions Precommits (#17479)

[noreply] [BEAM-14368][BEAM-13984]Change model loading from constructor to

[noreply] [BEAM-13983] changed file name from sklearn_loader to sklearn_inference

[noreply] Add SQL in Notebooks blog post (#17481)

[noreply] Merge pull request #17404: [BEAM-13990] support date and timestamp


------------------------------------------
[...truncated 21.12 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651308756184944697/****\022@83954ff4d7bcce2690d4a673e1350fbcfc4c0fe4b786057fb4b26fa0ffbd1f36"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/30 08:52:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651308756184944697/model
2022/04/30 08:52:36 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0428110815"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651308756184944697/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651308756184944697/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0428110815",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/30 08:52:37 Submitted job: 2022-04-30_01_52_36-17628502109478332266
2022/04/30 08:52:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-30_01_52_36-17628502109478332266?project=apache-beam-testing
2022/04/30 08:52:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-30_01_52_36-17628502109478332266
2022/04/30 08:52:37 Job state: JOB_STATE_PENDING ...
2022/04/30 08:53:07 Job still running ...
2022/04/30 08:53:37 Job still running ...
2022/04/30 08:54:07 Job still running ...
2022/04/30 08:54:37 Job still running ...
2022/04/30 08:55:07 Job still running ...
2022/04/30 08:55:37 Job still running ...
2022/04/30 08:56:07 Job still running ...
2022/04/30 08:56:37 Job still running ...
2022/04/30 08:57:07 Job still running ...
2022/04/30 08:57:37 Job still running ...
2022/04/30 08:58:07 Failed to execute job: job 2022-04-30_01_52_36-17628502109478332266 failed
panic: Failed to execute job: job 2022-04-30_01_52_36-17628502109478332266 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1215648, 0xc0000480c0, 0x10f1977, 0x19, 0xc0005dbe78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/xvcu6cvbtj4qk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #494

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/494/display/redirect?page=changes>

Changes:

[ihr] Update Java katas to Beam 2.38

[noreply] [BEAM-14369] Fix "target/options: no such file or directory" error while

[noreply] [BEAM-14351] Inherit from Coder. (#17437)

[noreply] [BEAM-14297] Enable nullable key and value arrays for xlang kafka io

[noreply] Merge pull request #17444 from [BEAM-14310] [Website] bug home

[noreply] Merge pull request #17388 from [BEAM-14311] [Website] Home Page

[noreply] [BEAM-14376] Typo in method description doc

[noreply] Add default classpath when not present (#17491)

[thiagotnunes] fix: update javadocs for ChangeStreamMetrics

[noreply] Merge pull request #17443 from [BEAM-12164]: use the end timestamp for

[noreply] Merge pull request #17260 from [BEAM-13229] [Website] bug side nav


------------------------------------------
[...truncated 21.20 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651222362035316820/****\022@83954ff4d7bcce2690d4a673e1350fbcfc4c0fe4b786057fb4b26fa0ffbd1f36"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/29 08:52:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651222362035316820/model
2022/04/29 08:52:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0428110815"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651222362035316820/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651222362035316820/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0428110815",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/29 08:52:43 Submitted job: 2022-04-29_01_52_42-4003736270684934459
2022/04/29 08:52:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-29_01_52_42-4003736270684934459?project=apache-beam-testing
2022/04/29 08:52:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-29_01_52_42-4003736270684934459
2022/04/29 08:52:43 Job state: JOB_STATE_PENDING ...
2022/04/29 08:53:13 Job still running ...
2022/04/29 08:53:43 Job still running ...
2022/04/29 08:54:13 Job still running ...
2022/04/29 08:54:43 Job still running ...
2022/04/29 08:55:13 Job still running ...
2022/04/29 08:55:43 Job still running ...
2022/04/29 08:56:13 Job still running ...
2022/04/29 08:56:43 Job still running ...
2022/04/29 08:57:13 Job still running ...
2022/04/29 08:57:43 Failed to execute job: job 2022-04-29_01_52_42-4003736270684934459 failed
panic: Failed to execute job: job 2022-04-29_01_52_42-4003736270684934459 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1215648, 0xc00012e000, 0x10f1977, 0x19, 0xc000347e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/j4dfeexz2qa2c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #493

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/493/display/redirect?page=changes>

Changes:

[nick.caballero] [BEAM-14363] Fixes WatermarkParameters builder for Kinesis

[noreply] [BEAM-11104] Add Checkpointing split to Go SDK (#17386)

[noreply] Merge pull request #17226 from [BEAM-14204] [Playground] Tests for

[noreply] [BEAM-13015, BEAM-14184] Address unbounded number of messages being

[noreply] Improvement to Seed job configuration to launch against PRs (#17468)

[noreply] [BEAM-13983] Small changes to sklearn runinference (#17459)

[chamikaramj] Renames ExternalPythonTransform to PythonExternalTransform


------------------------------------------
[...truncated 21.17 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651135960202821733/****\022@83954ff4d7bcce2690d4a673e1350fbcfc4c0fe4b786057fb4b26fa0ffbd1f36"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/28 08:52:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651135960202821733/model
2022/04/28 08:52:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0428000152"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651135960202821733/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651135960202821733/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0428000152",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/28 08:52:41 Submitted job: 2022-04-28_01_52_40-5300591829981154413
2022/04/28 08:52:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-28_01_52_40-5300591829981154413?project=apache-beam-testing
2022/04/28 08:52:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-28_01_52_40-5300591829981154413
2022/04/28 08:52:41 Job state: JOB_STATE_PENDING ...
2022/04/28 08:53:11 Job still running ...
2022/04/28 08:53:41 Job still running ...
2022/04/28 08:54:11 Job still running ...
2022/04/28 08:54:41 Job still running ...
2022/04/28 08:55:11 Job still running ...
2022/04/28 08:55:41 Failed to execute job: job 2022-04-28_01_52_40-5300591829981154413 failed
panic: Failed to execute job: job 2022-04-28_01_52_40-5300591829981154413 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1215648, 0xc0000480c0, 0x10f1977, 0x19, 0xc000229e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rpsvsj2cuvkaa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #492

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/492/display/redirect?page=changes>

Changes:

[msbukal] FhirIO: use .search() or .searchType instead of .setResourceType()

[noreply] Remove unnecessary decorator from RunInference interface (#17463)

[noreply] [BEAM-13590] Minor deprecated warning fix (#17453)

[noreply] [BEAM-12164]: fix the negative throughput issue (#17461)

[noreply] Updated goldens for the screen diff integration tests (#17467)

[noreply] fixes copy by value error for bytes.Buffer in Error (#17469)

[noreply] Merge pull request #17354 from [BEAM-14170] - Create a test that runs

[noreply] Merge pull request #17447 from [BEAM-14357] Fix

[noreply] [BEAM-14324, BEAM-14325] Staticcheck cleanup in test files (#17393)

[noreply] BEAM-14187 Fix NPE (#17454)

[noreply] [BEAM-11105] Stateful watermark estimation (#17374)

[noreply] [BEAM-14304] implement parquetio to read/write parquet files (#17347)


------------------------------------------
[...truncated 21.10 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651049556302881606/****\022@bb1e8c597cbb3e207a66c503448be06965f205db433bf49bd887a90d3ee9384d"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/27 08:52:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651049556302881606/model
2022/04/27 08:52:36 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0427065335"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651049556302881606/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651049556302881606/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0427065335",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/27 08:52:38 Submitted job: 2022-04-27_01_52_36-3184575387219685268
2022/04/27 08:52:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-27_01_52_36-3184575387219685268?project=apache-beam-testing
2022/04/27 08:52:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-27_01_52_36-3184575387219685268
2022/04/27 08:52:38 Job state: JOB_STATE_PENDING ...
2022/04/27 08:53:08 Job still running ...
2022/04/27 08:53:38 Job still running ...
2022/04/27 08:54:08 Job still running ...
2022/04/27 08:54:38 Job still running ...
2022/04/27 08:55:08 Job still running ...
2022/04/27 08:55:38 Job still running ...
2022/04/27 08:56:08 Job still running ...
2022/04/27 08:56:38 Job still running ...
2022/04/27 08:57:08 Job still running ...
2022/04/27 08:57:38 Failed to execute job: job 2022-04-27_01_52_36-3184575387219685268 failed
panic: Failed to execute job: job 2022-04-27_01_52_36-3184575387219685268 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1214228, 0xc00012e000, 0x10f0857, 0x19, 0xc000449e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 12s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/g2yu32cwky2sc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #491

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/491/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14343] Allow expansion service override in ExternalPythonTransform

[Heejong Lee] update

[Heejong Lee] allows remote host

[Heejong Lee] improve compatibility with python rowcoder

[ahmedabualsaud] added tempLocation to test pipeline options

[ahmedabualsaud] using tempRoot for temp bucket location

[ahmedabualsaud] small fixes

[noreply] [BEAM-14320] Update programming-guide w/Java GroupByKey example (#17369)

[noreply] Minor: Fix release script for `current` symlinks (#17457)

[noreply] Minor: fix typo (#17452)

[noreply] Change return type for PytorchInferenceRunner (#17460)

[noreply] [BEAM-13608] JmsIO dynamic topics feature (#17163)

[Heejong Lee] add test


------------------------------------------
[...truncated 20.77 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650963146937622124/****\022@ae31222cb0220ad1ba2ae80238d4a7e83e0bc220eceae738fed7b3a74855af59"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/26 08:52:27 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650963146937622124/model
2022/04/26 08:52:27 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0426065328"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650963146937622124/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650963146937622124/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0426065328",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/26 08:52:28 Submitted job: 2022-04-26_01_52_27-41932979974464158
2022/04/26 08:52:28 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-26_01_52_27-41932979974464158?project=apache-beam-testing
2022/04/26 08:52:28 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-26_01_52_27-41932979974464158
2022/04/26 08:52:28 Job state: JOB_STATE_PENDING ...
2022/04/26 08:52:58 Job still running ...
2022/04/26 08:53:28 Job still running ...
2022/04/26 08:53:58 Job still running ...
2022/04/26 08:54:28 Job still running ...
2022/04/26 08:54:58 Job still running ...
2022/04/26 08:55:28 Failed to execute job: job 2022-04-26_01_52_27-41932979974464158 failed
panic: Failed to execute job: job 2022-04-26_01_52_27-41932979974464158 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120efa8, 0xc00012e000, 0x10ec320, 0x19, 0xc00040fe78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 6s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/2mxudverfwxtm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #490

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/490/display/redirect>

Changes:


------------------------------------------
[...truncated 20.83 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650876748520459384/****\022@ae31222cb0220ad1ba2ae80238d4a7e83e0bc220eceae738fed7b3a74855af59"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/25 08:52:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650876748520459384/model
2022/04/25 08:52:29 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0425065332"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650876748520459384/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650876748520459384/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0425065332",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/25 08:52:29 Submitted job: 2022-04-25_01_52_29-1686124191416497343
2022/04/25 08:52:29 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-25_01_52_29-1686124191416497343?project=apache-beam-testing
2022/04/25 08:52:29 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-25_01_52_29-1686124191416497343
2022/04/25 08:52:29 Job state: JOB_STATE_PENDING ...
2022/04/25 08:52:59 Job still running ...
2022/04/25 08:53:29 Job still running ...
2022/04/25 08:53:59 Job still running ...
2022/04/25 08:54:29 Job still running ...
2022/04/25 08:55:00 Job still running ...
2022/04/25 08:55:30 Job still running ...
2022/04/25 08:56:00 Job still running ...
2022/04/25 08:56:30 Job still running ...
2022/04/25 08:57:00 Job still running ...
2022/04/25 08:57:30 Failed to execute job: job 2022-04-25_01_52_29-1686124191416497343 failed
panic: Failed to execute job: job 2022-04-25_01_52_29-1686124191416497343 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120efa8, 0xc0000480c0, 0x10ec320, 0x19, 0xc000413e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 6s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/cbevtsebqwknk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #489

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/489/display/redirect?page=changes>

Changes:

[noreply] [BEAM-13953] added documentation for BQ Storage Write API (#17391)


------------------------------------------
[...truncated 20.79 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650790349787425629/****\022@ae31222cb0220ad1ba2ae80238d4a7e83e0bc220eceae738fed7b3a74855af59"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/24 08:52:30 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650790349787425629/model
2022/04/24 08:52:30 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0424065331"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650790349787425629/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650790349787425629/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0424065331",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/24 08:52:30 Submitted job: 2022-04-24_01_52_30-12506313645757397146
2022/04/24 08:52:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-24_01_52_30-12506313645757397146?project=apache-beam-testing
2022/04/24 08:52:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-24_01_52_30-12506313645757397146
2022/04/24 08:52:31 Job state: JOB_STATE_PENDING ...
2022/04/24 08:53:01 Job still running ...
2022/04/24 08:53:31 Job still running ...
2022/04/24 08:54:01 Job still running ...
2022/04/24 08:54:31 Job still running ...
2022/04/24 08:55:01 Job still running ...
2022/04/24 08:55:31 Failed to execute job: job 2022-04-24_01_52_30-12506313645757397146 failed
panic: Failed to execute job: job 2022-04-24_01_52_30-12506313645757397146 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120efa8, 0xc00012e000, 0x10ec320, 0x19, 0xc000443e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 6s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/25gshjmntw2aq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #488

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/488/display/redirect?page=changes>

Changes:

[Andrew Pilloud] [BEAM-14321] SQL passes Null for Null aggregates

[noreply] Create apache-hop-with-dataflow.md

[noreply] Add files via upload

[noreply] Delete website/www/site/content/en/blog/apache-hop-with-dataflow

[noreply] Add files via upload

[Andrew Pilloud] [BEAM-14348] Upgrade to ZetaSQL 2022.04.1

[Andrew Pilloud] [BEAM-13735] Enable ZetaSQL tests for Java 17

[noreply] Update apache-hop-with-dataflow.md

[noreply] Update apache-hop-with-dataflow.md

[noreply] Update apache-hop-with-dataflow.md

[danielamartinmtz] Moved up get-credentials instruction for getting the kubeconfig file

[noreply] [BEAM-13657] Add python 3.6 update to CHANGES.md (#17435)

[noreply] Merge pull request #17438: [BEAM-8127] The GCP module to declare

[noreply] Merge pull request #17428: [BEAM-14326] Make sure BigQuery daemon thread

[noreply] [BEAM-14301] Add lint:ignore to noescape() func (#17355)

[noreply] [BEAM-14286] Remove unused vars in harness package (#17392)

[noreply] [BEAM-14327] Convert Results to QueryResults directly (#17398)

[noreply] [BEAM-14302] Simplify boolean check in fn.go (#17399)

[noreply] [BEAM-13983] Sklearn Loader for RunInference (#17368)

[noreply] Update authors.yml

[noreply] [BEAM-14358] add retry to connect to testcontainer (#17449)

[noreply] [BEAM-13106] Bump flink docs to 1.14 (#17430)


------------------------------------------
[...truncated 20.81 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650703957697779967/****\022@ae31222cb0220ad1ba2ae80238d4a7e83e0bc220eceae738fed7b3a74855af59"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/23 08:52:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650703957697779967/model
2022/04/23 08:52:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0423065334"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650703957697779967/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650703957697779967/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0423065334",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/23 08:52:38 Submitted job: 2022-04-23_01_52_38-702327544991581476
2022/04/23 08:52:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-23_01_52_38-702327544991581476?project=apache-beam-testing
2022/04/23 08:52:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-23_01_52_38-702327544991581476
2022/04/23 08:52:39 Job state: JOB_STATE_PENDING ...
2022/04/23 08:53:09 Job still running ...
2022/04/23 08:53:39 Job still running ...
2022/04/23 08:54:09 Job still running ...
2022/04/23 08:54:39 Job still running ...
2022/04/23 08:55:09 Job still running ...
2022/04/23 08:55:39 Job still running ...
2022/04/23 08:56:09 Job still running ...
2022/04/23 08:56:39 Job still running ...
2022/04/23 08:57:09 Job still running ...
2022/04/23 08:57:39 Failed to execute job: job 2022-04-23_01_52_38-702327544991581476 failed
panic: Failed to execute job: job 2022-04-23_01_52_38-702327544991581476 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120efa8, 0xc00012e000, 0x10ec320, 0x19, 0xc0004e9e78, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 15s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ym2ux6arpokg4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #487

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/487/display/redirect?page=changes>

Changes:

[mmack] [BEAM-14335] Spotless Spark sources

[mmack] [BEAM-14345] Force paranamer 2.8 for Spark Hadoop version tests to avoid

[noreply] BEAM-13582 Fixing broken links in the documentation (#17300)

[kamil.bregula] Revert "[BEAM-14300] Fix Java precommit failure"

[kamil.bregula] Revert "Merge pull request #17223 from [BEAM-14215] Improve argument

[noreply] [BEAM-13657] Sunset python 3.6 (#17252)

[noreply] Removes unsupported Python 3.6 from the release validation script

[noreply] [BEAM-13984] Implement RunInference for PyTorch (#17196)

[noreply] [BEAM-13945] add json type support for java bigquery connector (#17209)

[noreply] [BEAM-14346] Fix incorrect error case index in ret2() (#17425)

[noreply] [BEAM-14342] Fix wrong default buffer type in fn_runner (#17420)

[noreply] Updates opencensus-api dependency to the latest version - 0.31.0

[noreply] [BEAM-14306] Add unit testing to pane coder (#17370)

[noreply] Updated the dep and golden for screen diff integration tests (#17442)


------------------------------------------
[...truncated 20.83 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650617557339485147/****\022@e32ad4132daa59975755f6c01e39fc3493832ea387515d78468e39dd92e34f47"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/22 08:52:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650617557339485147/model
2022/04/22 08:52:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0422065338"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650617557339485147/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650617557339485147/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0422065338",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/22 08:52:38 Submitted job: 2022-04-22_01_52_38-6641399107909163874
2022/04/22 08:52:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-22_01_52_38-6641399107909163874?project=apache-beam-testing
2022/04/22 08:52:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-22_01_52_38-6641399107909163874
2022/04/22 08:52:38 Job state: JOB_STATE_PENDING ...
2022/04/22 08:53:08 Job still running ...
2022/04/22 08:53:38 Job still running ...
2022/04/22 08:54:08 Job still running ...
2022/04/22 08:54:38 Job still running ...
2022/04/22 08:55:08 Job still running ...
2022/04/22 08:55:38 Job still running ...
2022/04/22 08:56:08 Job still running ...
2022/04/22 08:56:38 Job still running ...
2022/04/22 08:57:08 Job still running ...
2022/04/22 08:57:38 Failed to execute job: job 2022-04-22_01_52_38-6641399107909163874 failed
panic: Failed to execute job: job 2022-04-22_01_52_38-6641399107909163874 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120efe8, 0xc00012e000, 0x10ec320, 0x19, 0xc00056fe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/kswtogxiqbldc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #486

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/486/display/redirect?page=changes>

Changes:

[vachan] Annotating Read API tests.

[bulat.safiullin] [BEAM-14247] [Website] add image

[bulat.safiullin] [BEAM-14247] [Website] center image

[mattcasters] BEAM-1857 : CHANGES.md entry for 2.38.0

[mmack] [BEAM-14323] Improve IDE integration of Spark cross version builds

[noreply] [BEAM-14112] Fixed ReadFromBigQuery with Interactive Beam (#17306)

[noreply] Update .asf.yaml (#17409)

[noreply] [BEAM-14336] Sickbay flight delays test - dataset seems to be missing

[noreply] [BEAM-14338] Update watermark unit tests to use time.Time.Equals()

[noreply] [BEAM-14328] Tweaks to "Differences from pandas" page (#17413)

[Andrew Pilloud] [BEAM-14253] Disable broken test pending Dataflow fix

[yiru] fix: BigQuery Storage Connector trace id population missing bracket

[noreply] [BEAM-14330] Temporarily disable the clusters auto-cleanup (#17400)

[noreply] Update Beam website to release 2.38.0 (#17378)

[noreply] [BEAM-14213] Add API and construction time validation for Batched DoFns

[noreply] Minor: Update release guide regarding archive.apache.org (#17419)

[noreply] [BEAM-14017] beam_PreCommit_CommunityMetrics_Cron test failing (#17396)


------------------------------------------
[...truncated 20.83 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650531153519134050/****\022@a6c7b776ce62fb60f60c03a7656048ec6b62dd09689e9e0d6f2c523cd816031f"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/21 08:52:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650531153519134050/model
2022/04/21 08:52:34 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0421065331"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650531153519134050/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650531153519134050/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0421065331",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/21 08:52:34 Submitted job: 2022-04-21_01_52_34-5024117400475821461
2022/04/21 08:52:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-21_01_52_34-5024117400475821461?project=apache-beam-testing
2022/04/21 08:52:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-21_01_52_34-5024117400475821461
2022/04/21 08:52:34 Job state: JOB_STATE_PENDING ...
2022/04/21 08:53:04 Job still running ...
2022/04/21 08:53:34 Job still running ...
2022/04/21 08:54:04 Job still running ...
2022/04/21 08:54:34 Job still running ...
2022/04/21 08:55:04 Job still running ...
2022/04/21 08:55:34 Job still running ...
2022/04/21 08:56:05 Job still running ...
2022/04/21 08:56:35 Job still running ...
2022/04/21 08:57:05 Job still running ...
2022/04/21 08:57:35 Failed to execute job: job 2022-04-21_01_52_34-5024117400475821461 failed
panic: Failed to execute job: job 2022-04-21_01_52_34-5024117400475821461 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120ef68, 0xc0000480c0, 0x10ec320, 0x19, 0xc0005cbe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 9s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/w3c34tpkkhpxe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #485

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/485/display/redirect?page=changes>

Changes:

[andyye333] Change func to PTransform

[noreply] Populate actual dataflow job id to bigquery write trace id (#17130)

[relax] mark static thread as a daemon thread

[noreply] [BEAM-13866] Add miscellaneous exec unit tests (#17363)


------------------------------------------
[...truncated 20.78 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650444756402739805/****\022@a6c7b776ce62fb60f60c03a7656048ec6b62dd09689e9e0d6f2c523cd816031f"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/20 08:52:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650444756402739805/model
2022/04/20 08:52:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0420065338"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650444756402739805/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650444756402739805/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0420065338",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/20 08:52:37 Submitted job: 2022-04-20_01_52_37-7897045588183610052
2022/04/20 08:52:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-20_01_52_37-7897045588183610052?project=apache-beam-testing
2022/04/20 08:52:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-20_01_52_37-7897045588183610052
2022/04/20 08:52:37 Job state: JOB_STATE_PENDING ...
2022/04/20 08:53:07 Job still running ...
2022/04/20 08:53:37 Job still running ...
2022/04/20 08:54:07 Job still running ...
2022/04/20 08:54:37 Job still running ...
2022/04/20 08:55:07 Job still running ...
2022/04/20 08:55:37 Failed to execute job: job 2022-04-20_01_52_37-7897045588183610052 failed
panic: Failed to execute job: job 2022-04-20_01_52_37-7897045588183610052 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120ef68, 0xc00012e000, 0x10ec320, 0x19, 0xc000427e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/2exaxlyqxoqgu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #484

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/484/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14251] add output_coder_override to ExpansionRequest

[Heejong Lee] remove null

[rarokni] [BEAM-14307] Fix Slow Side input pattern bug in sample

[Heejong Lee] better error msg

[Heejong Lee] update from comments

[noreply] [BEAM-14316] Introducing KafkaIO.Read implementation compatibility

[noreply] [BEAM-14290] Address staticcheck warnings in the reflectx package

[noreply] [BEAM-14302] Simply bools in fn.go, genx_test.go (#17356)

[noreply] Merge pull request #17382: [BEAM-12356] Close DatasetService leak as


------------------------------------------
[...truncated 20.85 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650358359420349718/****\022@a6c7b776ce62fb60f60c03a7656048ec6b62dd09689e9e0d6f2c523cd816031f"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/19 08:52:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650358359420349718/model
2022/04/19 08:52:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0419065336"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650358359420349718/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650358359420349718/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0419065336",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/19 08:52:40 Submitted job: 2022-04-19_01_52_40-2657181775903093408
2022/04/19 08:52:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-19_01_52_40-2657181775903093408?project=apache-beam-testing
2022/04/19 08:52:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-19_01_52_40-2657181775903093408
2022/04/19 08:52:40 Job state: JOB_STATE_PENDING ...
2022/04/19 08:53:10 Job still running ...
2022/04/19 08:53:40 Job still running ...
2022/04/19 08:54:10 Job still running ...
2022/04/19 08:54:40 Job still running ...
2022/04/19 08:55:10 Job still running ...
2022/04/19 08:55:41 Job still running ...
2022/04/19 08:56:11 Job still running ...
2022/04/19 08:56:41 Job still running ...
2022/04/19 08:57:11 Job still running ...
2022/04/19 08:57:41 Job still running ...
2022/04/19 08:58:11 Failed to execute job: job 2022-04-19_01_52_40-2657181775903093408 failed
panic: Failed to execute job: job 2022-04-19_01_52_40-2657181775903093408 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120ef68, 0xc0000480c0, 0x10ec320, 0x19, 0xc00076fe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 43s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/t723m2b5otjvs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #483

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/483/display/redirect>

Changes:


------------------------------------------
[...truncated 21.58 KB...]
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650271950996733028/****\022@a7815c61eb068319a467f449b33a934d6613c1364efa775c08c240b7e122c502"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/18 08:52:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650271950996733028/model
2022/04/18 08:52:31 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0418065332"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650271950996733028/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650271950996733028/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0418065332",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/18 08:52:32 Submitted job: 2022-04-18_01_52_31-8080883924122585986
2022/04/18 08:52:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-18_01_52_31-8080883924122585986?project=apache-beam-testing
2022/04/18 08:52:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-18_01_52_31-8080883924122585986
2022/04/18 08:52:32 Job state: JOB_STATE_PENDING ...
2022/04/18 08:53:02 Job still running ...
2022/04/18 08:53:32 Job still running ...
2022/04/18 08:54:02 Job still running ...
2022/04/18 08:54:32 Job still running ...
2022/04/18 08:55:02 Job still running ...
2022/04/18 08:55:32 Job still running ...
2022/04/18 08:56:02 Job still running ...
2022/04/18 08:56:32 Job still running ...
2022/04/18 08:57:02 Job still running ...
2022/04/18 08:57:32 Job still running ...
2022/04/18 08:58:02 Failed to execute job: job 2022-04-18_01_52_31-8080883924122585986 failed
panic: Failed to execute job: job 2022-04-18_01_52_31-8080883924122585986 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120ef68, 0xc00012e000, 0x10ec320, 0x19, 0xc0004d9e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 36s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...

Publishing failed.

The build scan server appears to be unavailable.
Please check https://status.gradle.com for the latest service status.

If the service is reported as available, please report this problem via https://gradle.com/help/plugin and include the following via copy/paste:

----------
Gradle version: 7.4
Plugin version: 3.4.1
Request URL: https://status.gradle.com
Request ID: 23263915-1fc8-4242-93f9-6cc9597d0c0b
Response status code: 405
Response server type: Varnish
----------

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #482

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/482/display/redirect>

Changes:


------------------------------------------
[...truncated 20.83 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650185549339530977/****\022@a7815c61eb068319a467f449b33a934d6613c1364efa775c08c240b7e122c502"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/17 08:52:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650185549339530977/model
2022/04/17 08:52:29 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0417065330"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650185549339530977/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650185549339530977/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0417065330",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/17 08:52:30 Submitted job: 2022-04-17_01_52_30-14088292313396731562
2022/04/17 08:52:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-17_01_52_30-14088292313396731562?project=apache-beam-testing
2022/04/17 08:52:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-17_01_52_30-14088292313396731562
2022/04/17 08:52:30 Job state: JOB_STATE_PENDING ...
2022/04/17 08:53:00 Job still running ...
2022/04/17 08:53:30 Job still running ...
2022/04/17 08:54:00 Job still running ...
2022/04/17 08:54:30 Job still running ...
2022/04/17 08:55:00 Job still running ...
2022/04/17 08:55:30 Failed to execute job: job 2022-04-17_01_52_30-14088292313396731562 failed
panic: Failed to execute job: job 2022-04-17_01_52_30-14088292313396731562 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120ef68, 0xc00012e000, 0x10ec320, 0x19, 0xc000605e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 6s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/b4wgfi4uev2ea

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #481

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/481/display/redirect?page=changes>

Changes:

[pandiana] BigQueryServicesImpl: reduce number of threads spawned by

[noreply] [BEAM-13204] Fix website bug where code tabs do not appear if the


------------------------------------------
[...truncated 20.91 KB...]
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650099152607853636/****\022@a7815c61eb068319a467f449b33a934d6613c1364efa775c08c240b7e122c502"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/16 08:52:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650099152607853636/model
2022/04/16 08:52:33 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0416065334"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650099152607853636/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650099152607853636/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0416065334",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/16 08:52:34 Submitted job: 2022-04-16_01_52_33-1522037718055616484
2022/04/16 08:52:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-16_01_52_33-1522037718055616484?project=apache-beam-testing
2022/04/16 08:52:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-16_01_52_33-1522037718055616484
2022/04/16 08:52:34 Job state: JOB_STATE_PENDING ...
2022/04/16 08:53:04 Job still running ...
2022/04/16 08:53:34 Job still running ...
2022/04/16 08:54:04 Job still running ...
2022/04/16 08:54:34 Job still running ...
2022/04/16 08:55:04 Job still running ...
2022/04/16 08:55:34 Job still running ...
2022/04/16 08:56:04 Job still running ...
2022/04/16 08:56:34 Job still running ...
2022/04/16 08:57:04 Job still running ...
2022/04/16 08:57:34 Job still running ...
2022/04/16 08:58:04 Job still running ...
2022/04/16 08:58:34 Failed to execute job: job 2022-04-16_01_52_33-1522037718055616484 failed
panic: Failed to execute job: job 2022-04-16_01_52_33-1522037718055616484 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120ef68, 0xc0000480c0, 0x10ec320, 0x19, 0xc0001f7e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 13s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6ux5rk7u5wiby

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #480

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/480/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Upgrade to Gradle 7.4

[Kenneth Knowles] Remove Python module dependency on Dataflow worker

[noreply] [BEAM-13925] Dont double assign committers if author or other reviewer

[noreply] [BEAM-13739] Remove deprecated shallow clone funcs (#17362)

[noreply] [BEAM-11104] Pipe Continuation to DataSource level (#17334)

[noreply] [BEAM-11105] Basic Watermark Estimation (Wall Clock Observing) (#17267)

[noreply] Respect output coder for TextIO. (#17367)

[noreply] Merge pull request #17200 from [BEAM-12164]: fix the autoscaling backlog

[noreply] [BEAM-17035] Call python3 directly when it is available. (#17366)

[noreply] Merge pull request #17375: [BEAM-8691] Declare newer


------------------------------------------
[...truncated 20.86 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650012751662518602/****\022@a7815c61eb068319a467f449b33a934d6613c1364efa775c08c240b7e122c502"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/15 08:52:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650012751662518602/model
2022/04/15 08:52:32 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0415065333"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650012751662518602/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650012751662518602/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0415065333",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/15 08:52:32 Submitted job: 2022-04-15_01_52_32-18232695421773148659
2022/04/15 08:52:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-15_01_52_32-18232695421773148659?project=apache-beam-testing
2022/04/15 08:52:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-15_01_52_32-18232695421773148659
2022/04/15 08:52:32 Job state: JOB_STATE_PENDING ...
2022/04/15 08:53:02 Job still running ...
2022/04/15 08:53:32 Job still running ...
2022/04/15 08:54:02 Job still running ...
2022/04/15 08:54:32 Job still running ...
2022/04/15 08:55:02 Job still running ...
2022/04/15 08:55:32 Job still running ...
2022/04/15 08:56:02 Job still running ...
2022/04/15 08:56:33 Job still running ...
2022/04/15 08:57:03 Job still running ...
2022/04/15 08:57:33 Job still running ...
2022/04/15 08:58:03 Failed to execute job: job 2022-04-15_01_52_32-18232695421773148659 failed
panic: Failed to execute job: job 2022-04-15_01_52_32-18232695421773148659 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120ef68, 0xc00012e000, 0x10ec320, 0x19, 0xc00041be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 40s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bioso2hjl45ti

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #479

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/479/display/redirect?page=changes>

Changes:

[relax] handle changing schemas in Storage API sink

[noreply] Fix a couple style issues (#17361)

[noreply] [BEAM-14287] Clean up staticcheck warnings in graph/coder (#17337)

[noreply] Improvements to dataflow job service for non-Python jobs. (#17338)

[noreply] Bump minimist (#17290)

[noreply] Bump ansi-regex (#17291)

[noreply] Bump nanoid (#17292)

[noreply] Bump lodash (#17293)

[noreply] Bump url-parse (#17294)

[noreply] Bump moment (#17328)

[noreply] Merge pull request #15549 from [BEAM-11997] Changed RedisIO


------------------------------------------
[...truncated 20.85 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649926354511717207/****\022@22fba295011b4a8a8c6a436bf4e7c4a60cbcd762863c554633966e6ac79e9c9f"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/14 08:52:35 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649926354511717207/model
2022/04/14 08:52:35 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0414065336"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649926354511717207/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649926354511717207/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0414065336",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/14 08:52:35 Submitted job: 2022-04-14_01_52_35-553041791240129556
2022/04/14 08:52:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-14_01_52_35-553041791240129556?project=apache-beam-testing
2022/04/14 08:52:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-14_01_52_35-553041791240129556
2022/04/14 08:52:35 Job state: JOB_STATE_PENDING ...
2022/04/14 08:53:05 Job still running ...
2022/04/14 08:53:35 Job still running ...
2022/04/14 08:54:05 Job still running ...
2022/04/14 08:54:35 Job still running ...
2022/04/14 08:55:05 Job still running ...
2022/04/14 08:55:35 Job still running ...
2022/04/14 08:56:05 Job still running ...
2022/04/14 08:56:35 Job still running ...
2022/04/14 08:57:05 Job still running ...
2022/04/14 08:57:36 Job still running ...
2022/04/14 08:58:06 Failed to execute job: job 2022-04-14_01_52_35-553041791240129556 failed
panic: Failed to execute job: job 2022-04-14_01_52_35-553041791240129556 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12098c8, 0xc0000480c0, 0x10e7448, 0x19, 0xc00040fe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/h75udff3q5yds

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #478

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/478/display/redirect?page=changes>

Changes:

[Valentyn Tymofieiev] Add remaining Dataflow test suites for Python 3.9.

[Heejong Lee] [BEAM-14232] Only resolve artifacts in expanded environments for Java

[noreply] Fix test ordering issue (#17350)

[buqian] Do not pass null to MoreObjects.firstNonNull as default value

[ningkang0957] [BEAM-14288] Fixed flaky test

[noreply] [BEAM-14277] Disables Spanner change streams tests (#17346)

[noreply] [BEAM-14219] Run cleanup script to remove stale prebuilt SDK container

[Heejong Lee] [BEAM-14300] Fix Java precommit failure

[noreply] [BEAM-14116] Rollback "Chunk commit requests dynamically (#17004)"

[noreply] [BEAM-13982] A base class for run inference (#16970)

[ningkang0957] Enumerates all possible expected strings when asserting

[noreply] [BEAM-13966] Add pivot(), a non-deferred column operation on categorical


------------------------------------------
[...truncated 20.92 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649839962630649926/****\022@c218fca90ae603c1dff38ea3160cadb60c58ce4e7771f20d3d8a4e15865f0363"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/13 08:52:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649839962630649926/model
2022/04/13 08:52:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0413065335"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649839962630649926/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649839962630649926/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0413065335",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/13 08:52:43 Submitted job: 2022-04-13_01_52_43-11937313770923870162
2022/04/13 08:52:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-13_01_52_43-11937313770923870162?project=apache-beam-testing
2022/04/13 08:52:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-13_01_52_43-11937313770923870162
2022/04/13 08:52:43 Job state: JOB_STATE_PENDING ...
2022/04/13 08:53:13 Job still running ...
2022/04/13 08:53:43 Job still running ...
2022/04/13 08:54:13 Job still running ...
2022/04/13 08:54:44 Job still running ...
2022/04/13 08:55:14 Job still running ...
2022/04/13 08:55:44 Job still running ...
2022/04/13 08:56:14 Job still running ...
2022/04/13 08:56:44 Job still running ...
2022/04/13 08:57:14 Job still running ...
2022/04/13 08:57:44 Job still running ...
2022/04/13 08:58:14 Failed to execute job: job 2022-04-13_01_52_43-11937313770923870162 failed
panic: Failed to execute job: job 2022-04-13_01_52_43-11937313770923870162 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12098c8, 0xc00012e000, 0x10e7448, 0x19, 0xc00041be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/sts3w4lwcriv4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #477

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/477/display/redirect?page=changes>

Changes:

[kamil.bregula] [BEAM-14215] Improve argument validation in SnowflakeIO

[benjamin.gonzalez] [BEAM-14013] Add PreCommit Kotlin examples Jenkins Job

[Andrew Pilloud] [BEAM-13151] Support multiple layers of AutoValue nesting

[Heejong Lee] [BEAM-14233] Merge requirements from expanded response for Java External

[benjamin.gonzalez] [BEAM-14013] Add spark, direct, flink runners as triggers for Kotlin

[noreply] [BEAM-13898] Add tests to the pubsubx package. (#17324)

[noreply] [BEAM-14285] Clean up Staticcheck Warnings in io packages (#17336)

[noreply] [BEAM-14187] Fix concurrency issue in IsmReaderImpl (#17201)

[noreply] [BEAM-14288] Skip flaking test

[noreply] Simplify specifying additional dependencies in Go SDK in XLang IOs

[noreply] [BEAM-14240] Clean staticcheck warnings in runner packages (#17340)

[Daniel Oliveira] [BEAM-13538] Workaround to fix go-licenses crash.


------------------------------------------
[...truncated 20.87 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649753568227905818/****\022@c218fca90ae603c1dff38ea3160cadb60c58ce4e7771f20d3d8a4e15865f0363"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/12 08:52:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649753568227905818/model
2022/04/12 08:52:48 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0412065337"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649753568227905818/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649753568227905818/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0412065337",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/12 08:52:50 Submitted job: 2022-04-12_01_52_48-1665305891956756105
2022/04/12 08:52:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-12_01_52_48-1665305891956756105?project=apache-beam-testing
2022/04/12 08:52:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-12_01_52_48-1665305891956756105
2022/04/12 08:52:50 Job state: JOB_STATE_PENDING ...
2022/04/12 08:53:20 Job still running ...
2022/04/12 08:53:50 Job still running ...
2022/04/12 08:54:20 Job still running ...
2022/04/12 08:54:50 Job still running ...
2022/04/12 08:55:20 Job still running ...
2022/04/12 08:55:50 Job still running ...
2022/04/12 08:56:20 Failed to execute job: job 2022-04-12_01_52_48-1665305891956756105 failed
panic: Failed to execute job: job 2022-04-12_01_52_48-1665305891956756105 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12098c8, 0xc0000480c0, 0x10e7448, 0x19, 0xc000861e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6owhvfsjnj7ze

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #476

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/476/display/redirect>

Changes:


------------------------------------------
[...truncated 20.80 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649667152287921679/****\022@6086a7217af1b20bf69346d3da00e222943ae5afb0f18e894c8d52c994bffb32"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/11 08:52:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649667152287921679/model
2022/04/11 08:52:32 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0411065334"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649667152287921679/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649667152287921679/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0411065334",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/11 08:52:36 Submitted job: 2022-04-11_01_52_32-2211719212921144291
2022/04/11 08:52:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-11_01_52_32-2211719212921144291?project=apache-beam-testing
2022/04/11 08:52:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-11_01_52_32-2211719212921144291
2022/04/11 08:52:36 Job state: JOB_STATE_PENDING ...
2022/04/11 08:53:06 Job still running ...
2022/04/11 08:53:36 Job still running ...
2022/04/11 08:54:06 Job still running ...
2022/04/11 08:54:36 Job still running ...
2022/04/11 08:55:06 Job still running ...
2022/04/11 08:55:36 Job still running ...
2022/04/11 08:56:06 Failed to execute job: job 2022-04-11_01_52_32-2211719212921144291 failed
panic: Failed to execute job: job 2022-04-11_01_52_32-2211719212921144291 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208108, 0xc0000480c0, 0x10e5ed4, 0x19, 0xc0005e5e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/uf64b62yls6x4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #475

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/475/display/redirect?page=changes>

Changes:

[chamikaramj] Re-raise exceptions swallowed in several Python I/O connectors

[noreply] Merge pull request #16928: [BEAM-11971] Re add reverted timer


------------------------------------------
[...truncated 20.80 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649580751454521030/****\022@6086a7217af1b20bf69346d3da00e222943ae5afb0f18e894c8d52c994bffb32"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/10 08:52:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649580751454521030/model
2022/04/10 08:52:32 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0410065334"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649580751454521030/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649580751454521030/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0410065334",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/10 08:52:32 Submitted job: 2022-04-10_01_52_32-1550297137829084709
2022/04/10 08:52:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-10_01_52_32-1550297137829084709?project=apache-beam-testing
2022/04/10 08:52:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-10_01_52_32-1550297137829084709
2022/04/10 08:52:32 Job state: JOB_STATE_PENDING ...
2022/04/10 08:53:02 Job still running ...
2022/04/10 08:53:32 Job still running ...
2022/04/10 08:54:02 Job still running ...
2022/04/10 08:54:32 Job still running ...
2022/04/10 08:55:02 Job still running ...
2022/04/10 08:55:32 Job still running ...
2022/04/10 08:56:03 Failed to execute job: job 2022-04-10_01_52_32-1550297137829084709 failed
panic: Failed to execute job: job 2022-04-10_01_52_32-1550297137829084709 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208108, 0xc0000480c0, 0x10e5ed4, 0x19, 0xc000331e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 37s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/opi6qhtxaekyw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #474

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/474/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-11714] Change spotBugs jenkins config

[Robert Bradshaw] Cleanup docs on Shared.

[Kyle Weaver] Nit: correct description for precommit cron jobs.

[benjamin.gonzalez] [BEAM-11714] Add dummy class for testing

[shivrajw] [BEAM-14236] Parquet IO support for list to conform with Apache Parquet

[benjamin.gonzalez] [BEAM-11714] Remove dummy class used for testing

[benjamin.gonzalez] [BEAM-11714] Spotbugs print toJenkins UI precommit_Java17

[noreply] [BEAM-13767] Remove eclipse plugin as it generates a lot of unused tasks

[noreply] [BEAM-10708] Updated beam_sql error message (#17314)

[noreply] [BEAM-14281] add as_deterministic_coder to nullable coder (#17322)

[noreply] Improvements to Beam/Spark quickstart. (#17129)

[chamikaramj] Disable BigQueryIOStorageWriteIT for Runner v2 test suite


------------------------------------------
[...truncated 20.87 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649494350758411595/****\022@6086a7217af1b20bf69346d3da00e222943ae5afb0f18e894c8d52c994bffb32"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/09 08:52:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649494350758411595/model
2022/04/09 08:52:31 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0409065341"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649494350758411595/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649494350758411595/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0409065341",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/09 08:52:31 Submitted job: 2022-04-09_01_52_31-9994517975425474716
2022/04/09 08:52:31 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-09_01_52_31-9994517975425474716?project=apache-beam-testing
2022/04/09 08:52:31 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-09_01_52_31-9994517975425474716
2022/04/09 08:52:31 Job state: JOB_STATE_PENDING ...
2022/04/09 08:53:02 Job still running ...
2022/04/09 08:53:32 Job still running ...
2022/04/09 08:54:02 Job still running ...
2022/04/09 08:54:32 Job still running ...
2022/04/09 08:55:02 Job still running ...
2022/04/09 08:55:32 Job still running ...
2022/04/09 08:56:02 Job still running ...
2022/04/09 08:56:32 Job still running ...
2022/04/09 08:57:02 Job still running ...
2022/04/09 08:57:32 Job still running ...
2022/04/09 08:58:02 Failed to execute job: job 2022-04-09_01_52_31-9994517975425474716 failed
panic: Failed to execute job: job 2022-04-09_01_52_31-9994517975425474716 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208108, 0xc00012e000, 0x10e5ed4, 0x19, 0xc0007dfe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 40s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dbmkysqzz2f24

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #473

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/473/display/redirect?page=changes>

Changes:

[johnjcasey] [BEAM-10529] add java and generic components of nullable xlang tests

[johnjcasey] [BEAM-10529] fix test case

[johnjcasey] [BEAM-10529] add coders and typehints to support nullable xlang coders

[johnjcasey] [BEAM-10529] update external builder to support nullable coder

[johnjcasey] [BEAM-10529] clean up coders.py

[johnjcasey] [BEAM-10529] add coder translation test

[johnjcasey] [BEAM-10529] add additional check to typecoder to not accidentally

[johnjcasey] [BEAM-10529] add test to retrieve nullable coder from typehint

[johnjcasey] [BEAM-10529] run spotless

[johnjcasey] [BEAM-10529] add go nullable coder

[johnjcasey] [BEAM-10529] cleanup extra println

[johnjcasey] [BEAM-10529] improve comments, clean up python

[bulat.safiullin] [BEAM-13992] [Website] update Contribute/Code Contribution Guide page

[bulat.safiullin] [BEAM-13992] [Website] change text, transfer tag a

[bulat.safiullin] [BEAM-13992] [Website] change code tags

[bulat.safiullin] [BEAM-13992] [Website] change text

[bulat.safiullin] [BEAM-13992] [Website] change text and links, add empty lines

[bulat.safiullin] [BEAM-13991] [Website] change links, add contribute file

[bulat.safiullin] [BEAM-13991] [Website] add content, add styles

[bulat.safiullin] [BEAM-13991] [Website] add images, add styles, delete spaces

[bulat.safiullin] [BEAM-13991] [Website] change url and aliases, delete bullet points

[bulat.safiullin] [BEAM-13991] [Website] add empty line

[bulat.safiullin] [BEAM-13992] [Website] change links, change text

[bulat.safiullin] [BEAM-13992] [Website] change links, add text, add dots

[bulat.safiullin] [BEAM-13992] [Website] change links, change text

[bulat.safiullin] [BEAM-13991] [Website] change styles, change quotes

[bulat.safiullin] [BEAM-13991] [Website] change link color

[bulat.safiullin] [BEAM-13992] [Website] change text, delete whitespace

[bulat.safiullin] [BEAM-13991] [Website] change text

[bulat.safiullin] [BEAM-13992] [Website] update text

[bulat.safiullin] [BEAM-13991] [Website] added changes from PR 13992, changed get-starting

[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -

[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -

[mmack] [BEAM-14104] Support shard aware aggregation in Kinesis writer.

[noreply] [BEAM-13015] Lookup the container for the step once when registering

[noreply] [BEAM-14175] Log read loop abort at debug rather than error (#17183)

[noreply] [BEAM-11745] Fix author list rendering (#17308)

[noreply] [BEAM-14144] Record JFR profiles when GC thrashing is detected (#17151)

[noreply] Factors enable_prime flag in when checking use_unified_worker conditions

[noreply] [BEAM-11104] Add ProcessContinuation type to Go SDK (#17265)

[noreply] BEAM-13939: Restructure Protos to fix namespace conflicts (#16961)

[noreply] [BEAM-14270] Mark {Snowflake/BigQuery}Services as @Internal (#17309)

[noreply] [BEAM-13901] Add unit tests for graphx/cogbk.go

[noreply] [BEAM-14259, BEAM-14266] Remove unused function, replace use of ptypes

[noreply] [BEAM-14274] Fix staticcheck warnings in pipelinex (#17311)

[noreply] [BEAM-13857] Switched Go IT script to using Go flags for expansion

[noreply] Update python beam-master container image. (#17313)


------------------------------------------
[...truncated 20.83 KB...]
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649407954649204033/****\022@6086a7217af1b20bf69346d3da00e222943ae5afb0f18e894c8d52c994bffb32"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/08 08:52:35 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649407954649204033/model
2022/04/08 08:52:35 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0408065335"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649407954649204033/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649407954649204033/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0408065335",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/08 08:52:35 Submitted job: 2022-04-08_01_52_35-18314829362751426795
2022/04/08 08:52:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-08_01_52_35-18314829362751426795?project=apache-beam-testing
2022/04/08 08:52:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-08_01_52_35-18314829362751426795
2022/04/08 08:52:35 Job state: JOB_STATE_PENDING ...
2022/04/08 08:53:06 Job still running ...
2022/04/08 08:53:36 Job still running ...
2022/04/08 08:54:06 Job still running ...
2022/04/08 08:54:36 Job still running ...
2022/04/08 08:55:06 Job still running ...
2022/04/08 08:55:36 Job still running ...
2022/04/08 08:56:06 Job still running ...
2022/04/08 08:56:36 Job still running ...
2022/04/08 08:57:06 Job still running ...
2022/04/08 08:57:36 Job still running ...
2022/04/08 08:58:06 Failed to execute job: job 2022-04-08_01_52_35-18314829362751426795 failed
panic: Failed to execute job: job 2022-04-08_01_52_35-18314829362751426795 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208108, 0xc00012e000, 0x10e5ed4, 0x19, 0xc0003abe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 45s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lllv7utbau52q

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #472

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/472/display/redirect?page=changes>

Changes:

[noreply] Avoid pr-bot state desync (#17299)

[noreply] [BEAM-14259] Clean up staticcheck warnings in the exec package (#17285)

[noreply] Minor: Prefer registered schema in SQL docs (#17298)

[Kyle Weaver] [BEAM-14262] Update plugins for Dockerized Jenkins.

[Kyle Weaver] Add ansicolor and ws-cleanup plugins.

[noreply] [Playground] add meta tags (#17207)

[noreply] fixes golint and deprecated issues in recent Go SDK import (#17304)

[noreply] [BEAM-14266] Replace deprecated ptypes package uses (#17302)

[noreply] [BEAM-11936] Fix rawtypes warnings in SnowflakeIO (#17257)

[noreply] Merge pull request #17262: [BEAM-14244] Use the supplied output


------------------------------------------
[...truncated 20.91 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649321565224622387/****\022@0ce3c247c46bf6ef4a6327eb2b2abfb646078ec15806d07b81543537e64a0508"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/07 08:52:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649321565224622387/model
2022/04/07 08:52:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0407065329"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649321565224622387/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649321565224622387/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0407065329",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/07 08:52:46 Submitted job: 2022-04-07_01_52_45-10020155928914638369
2022/04/07 08:52:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-07_01_52_45-10020155928914638369?project=apache-beam-testing
2022/04/07 08:52:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-07_01_52_45-10020155928914638369
2022/04/07 08:52:46 Job state: JOB_STATE_PENDING ...
2022/04/07 08:53:16 Job still running ...
2022/04/07 08:53:46 Job still running ...
2022/04/07 08:54:16 Job still running ...
2022/04/07 08:54:46 Job still running ...
2022/04/07 08:55:16 Job still running ...
2022/04/07 08:55:46 Job still running ...
2022/04/07 08:56:17 Failed to execute job: job 2022-04-07_01_52_45-10020155928914638369 failed
panic: Failed to execute job: job 2022-04-07_01_52_45-10020155928914638369 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203b48, 0xc00012e000, 0x10e2007, 0x19, 0xc00054de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gif2po2jeqrle

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #471

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/471/display/redirect?page=changes>

Changes:

[bingyeli] update query

[Robert Bradshaw] [BEAM-14250] Fix coder registration for types defined in __main__.

[johnjcasey] [BEAM-14256] update SpEL dependency to 5.3.18.RELEASE

[johnjcasey] [BEAM-14256] remove .RELEASE

[dannymccormick] Fix dependency issue causing failures

[Kyle Weaver] [BEAM-9649] Add region option to Mongo Dataflow test.

[noreply] Allow get_coder(None).

[noreply] [BEAM-13015] Disable retries for fnapi grpc channels which otherwise

[noreply] [BEAM-13952] Sickbay

[noreply] BEAM-14235 parquetio module does not parse PEP-440 compliant Pyarrow

[noreply] [Website] Contribution guide page indent bug fix (#17287)

[noreply] [BEAM-10976] Document go sdk bundle finalization (#17048)

[noreply] [BEAM-13829] Expose status API from Go SDK Harness (#16957)


------------------------------------------
[...truncated 20.86 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649235165226627499/****\022@e4f4bdf8377d8787bd9168a5439366ab26d8f6c6e60049ed617e8fc0f9ad2e23"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/06 08:52:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649235165226627499/model
2022/04/06 08:52:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0406065348"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649235165226627499/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649235165226627499/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0406065348",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/06 08:52:46 Submitted job: 2022-04-06_01_52_45-13972298481064314288
2022/04/06 08:52:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-06_01_52_45-13972298481064314288?project=apache-beam-testing
2022/04/06 08:52:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-06_01_52_45-13972298481064314288
2022/04/06 08:52:46 Job state: JOB_STATE_PENDING ...
2022/04/06 08:53:16 Job still running ...
2022/04/06 08:53:46 Job still running ...
2022/04/06 08:54:16 Job still running ...
2022/04/06 08:54:46 Job still running ...
2022/04/06 08:55:16 Job still running ...
2022/04/06 08:55:46 Failed to execute job: job 2022-04-06_01_52_45-13972298481064314288 failed
panic: Failed to execute job: job 2022-04-06_01_52_45-13972298481064314288 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203ac8, 0xc00012e000, 0x10e2007, 0x19, 0xc0008c3e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 22s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ifjbovhbq45bw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #470

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/470/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-8970] Add docs to run wordcount example on portable Spark Runner

[Kiley Sok] Update python container version

[benjamin.gonzalez] [BEAM-8970] Add period to end of sentence

[Kyle Weaver] Add self-descriptive message for expected errors.

[noreply] Add --dataflowServiceOptions=enable_prime to useUnifiedWorker conditions

[noreply] [BEAM-10529] nullable xlang coder (#16923)

[noreply] Fix go fmt break in core/typex/special.go (#17266)

[noreply] [BEAM-5436] Add doc page on Go cross compilation. (#17256)

[noreply] Pr-bot Don't count all reviews as approvals (#17269)

[noreply] Fix postcommits (#17263)

[noreply] [BEAM-14241] Address staticcheck warnings in boot.go (#17264)

[noreply] [BEAM-14157] GrpcWindmillServer: Use stream specific boolean to do

[noreply] [BEAM-10582] Allow (and test) pyarrow 7 (#17229)

[noreply] [BEAM-13519] Solve race issues when the server responds with an error


------------------------------------------
[...truncated 20.96 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649148761597041113/****\022@e82b65becbc408b3b819abe1886ecf100a10b72cf7827668923fcb006e159142"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/05 08:52:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649148761597041113/model
2022/04/05 08:52:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0405065347"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649148761597041113/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649148761597041113/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0405065347",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/05 08:52:42 Submitted job: 2022-04-05_01_52_42-5234699001080865889
2022/04/05 08:52:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-05_01_52_42-5234699001080865889?project=apache-beam-testing
2022/04/05 08:52:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-05_01_52_42-5234699001080865889
2022/04/05 08:52:42 Job state: JOB_STATE_PENDING ...
2022/04/05 08:53:12 Job still running ...
2022/04/05 08:53:43 Job still running ...
2022/04/05 08:54:13 Job still running ...
2022/04/05 08:54:43 Job still running ...
2022/04/05 08:55:13 Job still running ...
2022/04/05 08:55:43 Job still running ...
2022/04/05 08:56:13 Failed to execute job: job 2022-04-05_01_52_42-5234699001080865889 failed
panic: Failed to execute job: job 2022-04-05_01_52_42-5234699001080865889 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11625c8, 0xc00012e000, 0x104decd, 0x19, 0xc0003f9e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/uefbko6f476xg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #469

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/469/display/redirect>

Changes:


------------------------------------------
[...truncated 20.82 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649062353600717132/****\022@0b3ce430819ad1b7aa2254b98b7c797ed4ef23d341fe87ec4607ed9c45458a63"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/04 08:52:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649062353600717132/model
2022/04/04 08:52:34 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0404065338"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649062353600717132/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649062353600717132/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0404065338",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/04 08:52:37 Submitted job: 2022-04-04_01_52_34-10204321761325285549
2022/04/04 08:52:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-04_01_52_34-10204321761325285549?project=apache-beam-testing
2022/04/04 08:52:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-04_01_52_34-10204321761325285549
2022/04/04 08:52:37 Job state: JOB_STATE_PENDING ...
2022/04/04 08:53:07 Job still running ...
2022/04/04 08:53:37 Job still running ...
2022/04/04 08:54:07 Job still running ...
2022/04/04 08:54:37 Job still running ...
2022/04/04 08:55:07 Job still running ...
2022/04/04 08:55:37 Job still running ...
2022/04/04 08:56:07 Job still running ...
2022/04/04 08:56:37 Job still running ...
2022/04/04 08:57:07 Job still running ...
2022/04/04 08:57:37 Job still running ...
2022/04/04 08:58:07 Failed to execute job: job 2022-04-04_01_52_34-10204321761325285549 failed
panic: Failed to execute job: job 2022-04-04_01_52_34-10204321761325285549 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11610e8, 0xc0000480c0, 0x104cb68, 0x19, 0xc0007bbe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 42s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/avckoxdul2zdi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #468

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/468/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14143] Simplifies the ExternalPythonTransform API (#17101)


------------------------------------------
[...truncated 20.93 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648975966842508818/****\022@0b3ce430819ad1b7aa2254b98b7c797ed4ef23d341fe87ec4607ed9c45458a63"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/03 08:52:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648975966842508818/model
2022/04/03 08:52:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0403065335"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648975966842508818/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648975966842508818/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0403065335",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/03 08:52:48 Submitted job: 2022-04-03_01_52_47-14713728110899671253
2022/04/03 08:52:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-03_01_52_47-14713728110899671253?project=apache-beam-testing
2022/04/03 08:52:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-03_01_52_47-14713728110899671253
2022/04/03 08:52:48 Job state: JOB_STATE_PENDING ...
2022/04/03 08:53:18 Job still running ...
2022/04/03 08:53:48 Job still running ...
2022/04/03 08:54:18 Job still running ...
2022/04/03 08:54:48 Job still running ...
2022/04/03 08:55:18 Job still running ...
2022/04/03 08:55:48 Job still running ...
2022/04/03 08:56:18 Job still running ...
2022/04/03 08:56:48 Job still running ...
2022/04/03 08:57:18 Job still running ...
2022/04/03 08:57:49 Job still running ...
2022/04/03 08:58:19 Failed to execute job: job 2022-04-03_01_52_47-14713728110899671253 failed
panic: Failed to execute job: job 2022-04-03_01_52_47-14713728110899671253 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11610e8, 0xc0000480c0, 0x104cb68, 0x19, 0xc00057be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/qopwsqkdprspo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #467

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/467/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14133] Fix potential NPE in BigQueryServicesImpl.getErrorInfo

[Robert Bradshaw] Revert "Revert "[BEAM-14038] Auto-startup for Python expansion service.

[Robert Bradshaw] Skip failing test for now.

[Kyle Weaver] [BEAM-14225] load balance jenkins jobs

[noreply] [BEAM-14153] Reshuffled Row Coder PCollection used as Side Input cause

[noreply] delint go sdk (#17247)

[Heejong Lee] add test

[noreply] Merge pull request #16841 from [BEAM-8823] Make FnApiRunner work by

[noreply] [BEAM-14192] Update legacy container version (#17210)

[noreply] Fix mishandling of API with BQIO (#17211)

[noreply] [BEAM-14221] Update documentation with Flink on Dataproc features

[Kiley Sok] Revert "[BEAM-14190] Python sends dataflow schema field"


------------------------------------------
[...truncated 20.86 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648889567000753168/****\022@0b3ce430819ad1b7aa2254b98b7c797ed4ef23d341fe87ec4607ed9c45458a63"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/02 08:52:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648889567000753168/model
2022/04/02 08:52:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0402065342"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648889567000753168/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648889567000753168/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0402065342",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/02 08:52:48 Submitted job: 2022-04-02_01_52_47-10052156490758174522
2022/04/02 08:52:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-02_01_52_47-10052156490758174522?project=apache-beam-testing
2022/04/02 08:52:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-02_01_52_47-10052156490758174522
2022/04/02 08:52:48 Job state: JOB_STATE_PENDING ...
2022/04/02 08:53:18 Job still running ...
2022/04/02 08:53:48 Job still running ...
2022/04/02 08:54:18 Job still running ...
2022/04/02 08:54:48 Job still running ...
2022/04/02 08:55:18 Job still running ...
2022/04/02 08:55:48 Job still running ...
2022/04/02 08:56:18 Job still running ...
2022/04/02 08:56:48 Failed to execute job: job 2022-04-02_01_52_47-10052156490758174522 failed
panic: Failed to execute job: job 2022-04-02_01_52_47-10052156490758174522 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11610e8, 0xc00012e000, 0x104cb68, 0x19, 0xc000853e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/zfxb4pivdx5iy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #466

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/466/display/redirect?page=changes>

Changes:

[bulat.safiullin] [BEAM-14164] [Website] change styles

[Andrew Pilloud] [BEAM-14190] Python sends dataflow schema field

[noreply] [BEAM-14179] Fix possibly null value

[noreply] [BEAM-12815] Try to fix flaky Flink Post Commit (#17227)

[noreply] Add a portable job server that proxies the Dataflow backend. (#17189)

[noreply] [BEAM-14130] Implement JupyterLab extension for managing Dataproc

[Andrew Pilloud] [BEAM-13741] Remove forced calcite dependency from BaseBeamTable

[noreply] [BEAM-13951] Update release guide with pointers on updating


------------------------------------------
[...truncated 20.80 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648803158774990428/****\022@86d0864103ef9e7f925915d5bdb833307ee2e386ab77064633a6df3826e74957"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/01 08:52:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648803158774990428/model
2022/04/01 08:52:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0401070842"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648803158774990428/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648803158774990428/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0401070842",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/01 08:52:39 Submitted job: 2022-04-01_01_52_39-11046931187097133105
2022/04/01 08:52:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-01_01_52_39-11046931187097133105?project=apache-beam-testing
2022/04/01 08:52:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-01_01_52_39-11046931187097133105
2022/04/01 08:52:39 Job state: JOB_STATE_PENDING ...
2022/04/01 08:53:09 Job still running ...
2022/04/01 08:53:40 Job still running ...
2022/04/01 08:54:10 Job still running ...
2022/04/01 08:54:40 Job still running ...
2022/04/01 08:55:10 Job still running ...
2022/04/01 08:55:40 Job still running ...
2022/04/01 08:56:10 Failed to execute job: job 2022-04-01_01_52_39-11046931187097133105 failed
panic: Failed to execute job: job 2022-04-01_01_52_39-11046931187097133105 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115f3c8, 0xc00012e000, 0x104b168, 0x19, 0xc0003e5e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 43s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wkm7znnhuokhi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #465

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/465/display/redirect?page=changes>

Changes:

[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn

[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn

[egalpin] [BEAM-14003] Adds compat for Elasticsearch 8.0.0

[egalpin] [BEAM-13136] Removes support for Elasticsearch 2.x

[noreply] Merge pull request #17149 from [BEAM-13883] [Playground] Increase test

[Kiley Sok] ignore test

[noreply] [BEAM-13948] Add unstack(), a non-deferred column operation on

[noreply] [BEAM-10976] Bundle finalization: E2E support (#17045)


------------------------------------------
[...truncated 20.90 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648716772564844599/****\022@86d0864103ef9e7f925915d5bdb833307ee2e386ab77064633a6df3826e74957"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/31 08:52:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648716772564844599/model
2022/03/31 08:52:53 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0331070827"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648716772564844599/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648716772564844599/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0331070827",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/31 08:52:53 Submitted job: 2022-03-31_01_52_53-14288943524683952878
2022/03/31 08:52:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-31_01_52_53-14288943524683952878?project=apache-beam-testing
2022/03/31 08:52:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-31_01_52_53-14288943524683952878
2022/03/31 08:52:53 Job state: JOB_STATE_PENDING ...
2022/03/31 08:53:23 Job still running ...
2022/03/31 08:53:54 Job still running ...
2022/03/31 08:54:24 Job still running ...
2022/03/31 08:54:54 Job still running ...
2022/03/31 08:55:24 Job still running ...
2022/03/31 08:55:54 Job still running ...
2022/03/31 08:56:24 Job still running ...
2022/03/31 08:56:54 Job still running ...
2022/03/31 08:57:24 Job still running ...
2022/03/31 08:57:54 Job still running ...
2022/03/31 08:58:24 Failed to execute job: job 2022-03-31_01_52_53-14288943524683952878 failed
panic: Failed to execute job: job 2022-03-31_01_52_53-14288943524683952878 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115f3c8, 0xc00012e000, 0x104b168, 0x19, 0xc00057be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/uqorc5fghvzv6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #464

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/464/display/redirect?page=changes>

Changes:

[vachan] Update display data to include BQ information.

[noreply] Revert "[BEAM-14084] iterable_input_value_types changed from list to

[chamikaramj] Convert URLs to local jars when constructing filesToStage

[Valentyn Tymofieiev] Ensure the removed option prebuild_sdk_container_base_image not used on

[noreply] [BEAM-13314]Revise recommendations to manage Python pipeline

[noreply] Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for

[noreply] Merge pull request #17080 from [BEAM-13880] [Playground] Increase test

[noreply] Merge pull request #17050 from [BEAM-13877] [Playground] Increase test

[noreply] [BEAM-14200] Improve SamzaJobInvoker extensibility (#17212)

[noreply] Merge pull request #17148 from [BEAM-14042] [playground] Scroll imports

[noreply] [BEAM-13918] Increase datastoreio go sdk unit test coverage (#17173)

[noreply] Merge pull request #16819: [BEAM-13806] Adding test suite for Go x-lang


------------------------------------------
[...truncated 20.82 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648630353111152454/****\022@29da67775e68520899e1a07a873782705cd7948f66ecc24ec5ee54fb321458a2"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/30 08:52:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648630353111152454/model
2022/03/30 08:52:33 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0330065346"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648630353111152454/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648630353111152454/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0330065346",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/30 08:52:34 Submitted job: 2022-03-30_01_52_33-514203447587559473
2022/03/30 08:52:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-30_01_52_33-514203447587559473?project=apache-beam-testing
2022/03/30 08:52:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-30_01_52_33-514203447587559473
2022/03/30 08:52:34 Job state: JOB_STATE_PENDING ...
2022/03/30 08:53:04 Job still running ...
2022/03/30 08:53:34 Job still running ...
2022/03/30 08:54:04 Job still running ...
2022/03/30 08:54:34 Job still running ...
2022/03/30 08:55:04 Job still running ...
2022/03/30 08:55:34 Job still running ...
2022/03/30 08:56:04 Job still running ...
2022/03/30 08:56:34 Job still running ...
2022/03/30 08:57:04 Job still running ...
2022/03/30 08:57:35 Job still running ...
2022/03/30 08:58:05 Failed to execute job: job 2022-03-30_01_52_33-514203447587559473 failed
panic: Failed to execute job: job 2022-03-30_01_52_33-514203447587559473 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc00012e000, 0x10484a4, 0x19, 0xc0003f3e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/kczrnwzl7xugo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #463

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/463/display/redirect?page=changes>

Changes:

[hengfeng] feat: remove the metadata table after the pipeline finishes

[thiagotnunes] test: add test for metadata table dropping

[noreply] Minor: Add warning about pubsub client to Beam 2.36.0 blog (#17188)

[noreply] [BEAM-14177] Fix GBK re-iteration caching for portable runners. (#17184)

[noreply] Merge pull request #17187: [BEAM-14181] Make sure to evict connections

[noreply] Only reset transform.label if it is correctly assigned (#17192)

[noreply] [BEAM-12641] Use google-auth instead of oauth2client for GCP auth

[Robert Bradshaw] [BEAM-14163] Fix typo in single core per container logic.

[thiagotnunes] test: disable SpannerIO.readChangeStream test

[noreply] Merge pull request #17164 from [BEAM-14140][Playground] Fix Deploy

[noreply] Merge pull request #16855 from [BEAM-13938][Playground] Increase test


------------------------------------------
[...truncated 20.94 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648544050228224192/****\022@29da67775e68520899e1a07a873782705cd7948f66ecc24ec5ee54fb321458a2"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/29 08:54:11 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648544050228224192/model
2022/03/29 08:54:11 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0329065351"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648544050228224192/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648544050228224192/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0329065351",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/29 08:54:11 Submitted job: 2022-03-29_01_54_11-9364725710779141411
2022/03/29 08:54:11 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-29_01_54_11-9364725710779141411?project=apache-beam-testing
2022/03/29 08:54:11 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-29_01_54_11-9364725710779141411
2022/03/29 08:54:11 Job state: JOB_STATE_PENDING ...
2022/03/29 08:54:41 Job still running ...
2022/03/29 08:55:12 Job still running ...
2022/03/29 08:55:42 Job still running ...
2022/03/29 08:56:12 Job still running ...
2022/03/29 08:56:42 Job still running ...
2022/03/29 08:57:12 Job still running ...
2022/03/29 08:57:42 Job still running ...
2022/03/29 08:58:12 Job still running ...
2022/03/29 08:58:42 Job still running ...
2022/03/29 08:59:12 Job still running ...
2022/03/29 08:59:43 Failed to execute job: job 2022-03-29_01_54_11-9364725710779141411 failed
panic: Failed to execute job: job 2022-03-29_01_54_11-9364725710779141411 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc0000480c0, 0x10484a4, 0x19, 0xc00067fe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 42s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mm726zudbp5nw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #462

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/462/display/redirect>

Changes:


------------------------------------------
[...truncated 20.89 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648457568801165307/****\022@29da67775e68520899e1a07a873782705cd7948f66ecc24ec5ee54fb321458a2"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/28 08:52:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648457568801165307/model
2022/03/28 08:52:49 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0328065329"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648457568801165307/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648457568801165307/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0328065329",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/28 08:52:50 Submitted job: 2022-03-28_01_52_49-3409494372809340330
2022/03/28 08:52:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-28_01_52_49-3409494372809340330?project=apache-beam-testing
2022/03/28 08:52:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-28_01_52_49-3409494372809340330
2022/03/28 08:52:50 Job state: JOB_STATE_PENDING ...
2022/03/28 08:53:20 Job still running ...
2022/03/28 08:53:50 Job still running ...
2022/03/28 08:54:20 Job still running ...
2022/03/28 08:54:50 Job still running ...
2022/03/28 08:55:20 Job still running ...
2022/03/28 08:55:50 Job still running ...
2022/03/28 08:56:20 Failed to execute job: job 2022-03-28_01_52_49-3409494372809340330 failed
panic: Failed to execute job: job 2022-03-28_01_52_49-3409494372809340330 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc0000480c0, 0x10484a4, 0x19, 0xc0002dbe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/cz67pzqvoleza

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #461

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/461/display/redirect>

Changes:


------------------------------------------
[...truncated 20.88 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648371159254566229/****\022@29da67775e68520899e1a07a873782705cd7948f66ecc24ec5ee54fb321458a2"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/27 08:52:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648371159254566229/model
2022/03/27 08:52:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0327065340"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648371159254566229/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648371159254566229/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0327065340",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/27 08:52:40 Submitted job: 2022-03-27_01_52_40-17875084883336652885
2022/03/27 08:52:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-27_01_52_40-17875084883336652885?project=apache-beam-testing
2022/03/27 08:52:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-27_01_52_40-17875084883336652885
2022/03/27 08:52:40 Job state: JOB_STATE_PENDING ...
2022/03/27 08:53:10 Job still running ...
2022/03/27 08:53:40 Job still running ...
2022/03/27 08:54:10 Job still running ...
2022/03/27 08:54:40 Job still running ...
2022/03/27 08:55:11 Job still running ...
2022/03/27 08:55:41 Job still running ...
2022/03/27 08:56:11 Failed to execute job: job 2022-03-27_01_52_40-17875084883336652885 failed
panic: Failed to execute job: job 2022-03-27_01_52_40-17875084883336652885 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc0000480c0, 0x10484a4, 0x19, 0xc000413e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/r3vdlcarsiwhs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #460

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/460/display/redirect?page=changes>

Changes:

[ryanthompson591] iterable_input_value_types will now be an iterable, I don't anticipate

[marco.robles] [BEAM-8218] PulsarIO Connector

[benjamin.gonzalez] [BEAM-12572] Change examples jobs to run as cron jobs

[benjamin.gonzalez] [BEAM-12572] SpotlessApply

[Robert Bradshaw] [BEAM-14171] More explicit asserts in CoGBKResult.

[Robert Bradshaw] Add some comments.

[noreply] [BEAM-14160] Parse filesToStage in Java expansion service (#17167)

[chamikaramj] Mapped JOB_STATE_RESOURCE_CLEANING_UP to RESOURCE_CLEANING_UP in Python

[noreply] Explicitly import estimator from tensorflow (#17168)


------------------------------------------
[...truncated 20.89 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648284760846348891/****\022@29da67775e68520899e1a07a873782705cd7948f66ecc24ec5ee54fb321458a2"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/26 08:52:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648284760846348891/model
2022/03/26 08:52:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0326065344"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648284760846348891/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648284760846348891/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0326065344",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/26 08:52:41 Submitted job: 2022-03-26_01_52_41-11331689795708641025
2022/03/26 08:52:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-26_01_52_41-11331689795708641025?project=apache-beam-testing
2022/03/26 08:52:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-26_01_52_41-11331689795708641025
2022/03/26 08:52:42 Job state: JOB_STATE_PENDING ...
2022/03/26 08:53:12 Job still running ...
2022/03/26 08:53:42 Job still running ...
2022/03/26 08:54:12 Job still running ...
2022/03/26 08:54:42 Job still running ...
2022/03/26 08:55:12 Job still running ...
2022/03/26 08:55:42 Job still running ...
2022/03/26 08:56:12 Failed to execute job: job 2022-03-26_01_52_41-11331689795708641025 failed
panic: Failed to execute job: job 2022-03-26_01_52_41-11331689795708641025 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc0000480c0, 0x10484a4, 0x19, 0xc000415e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dfqea3kydyrls

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #459

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/459/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-14139] Drop support for Flink 1.11.

[Kyle Weaver] [BEAM-14139] Remove obsolete reference to Flink 1.11.

[Kyle Weaver] [BEAM-14139] Update list of supported Flink versions.

[Kyle Weaver] [BEAM-14139] Update CHANGES.md

[noreply] [BEAM-14157] Don't call requestObserver.onNext on a closed windmill

[noreply] Minor: Make IOTypeHints a real NamedTuple (#17174)

[noreply] [BEAM-14172] Update tox.ini for pydocs (#17176)

[noreply] [BEAM-14065] Upgrade vendored bytebuddy to version 1.12.8 (#17028)


------------------------------------------
[...truncated 20.98 KB...]
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648198360164855440/****\022@29da67775e68520899e1a07a873782705cd7948f66ecc24ec5ee54fb321458a2"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/25 08:52:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648198360164855440/model
2022/03/25 08:52:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0325065346"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648198360164855440/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648198360164855440/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0325065346",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/25 08:52:41 Submitted job: 2022-03-25_01_52_40-15918739161672756798
2022/03/25 08:52:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-25_01_52_40-15918739161672756798?project=apache-beam-testing
2022/03/25 08:52:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-25_01_52_40-15918739161672756798
2022/03/25 08:52:41 Job state: JOB_STATE_PENDING ...
2022/03/25 08:53:11 Job state: JOB_STATE_PENDING ...
2022/03/25 08:53:41 Job state: JOB_STATE_PENDING ...
2022/03/25 08:54:11 Job still running ...
2022/03/25 08:54:41 Job still running ...
2022/03/25 08:55:11 Job still running ...
2022/03/25 08:55:41 Job still running ...
2022/03/25 08:56:11 Job still running ...
2022/03/25 08:56:41 Job still running ...
2022/03/25 08:57:11 Job still running ...
2022/03/25 08:57:41 Job still running ...
2022/03/25 08:58:11 Job still running ...
2022/03/25 08:58:41 Job still running ...
2022/03/25 08:59:12 Job still running ...
2022/03/25 08:59:42 Failed to execute job: job 2022-03-25_01_52_40-15918739161672756798 failed
panic: Failed to execute job: job 2022-03-25_01_52_40-15918739161672756798 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc00012e000, 0x10484a4, 0x19, 0xc0003fbe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 7m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/yanru46uxflok

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #458

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/458/display/redirect?page=changes>

Changes:

[bulat.safiullin] [BEAM-13976] [Website] update homepage

[bulat.safiullin] [BEAM-13976] [Website] update homepage, add logo

[bulat.safiullin] [BEAM-13976] [Website] update text

[bulat.safiullin] [BEAM-13976] [Website] Update Community landing page

[bulat.safiullin] [BEAM-13979] [Website] Update Community/Contact us page

[bulat.safiullin] [BEAM-13979] [Website] update title

[bulat.safiullin] [BEAM-13979] [Website] delete space

[bulat.safiullin] [BEAM-13979] [Website] add Beam Playground

[bulat.safiullin] [BEAM-13976] [Website] delete Beam Playground

[bulat.safiullin] [BEAM-13976] [Website] change navbar css links rules, delete links from

[bulat.safiullin] [BEAM-13977] [Website] delete available-contact-channels on mobile

[bulat.safiullin] [BEAM-13976] [Website] change padding size between the sections

[bulat.safiullin] [BEAM-13976] [Website] change title to capital letters

[bulat.safiullin] [BEAM-13976] [Website] change title

[bulat.safiullin] [BEAM-14040] [Website] create new page, add link

[bulat.safiullin] [BEAM-13977] [Website] change title

[bulat.safiullin] [BEAM-13979] [Website] change text

[bulat.safiullin] [BEAM-13976] [Website] change text

[bulat.safiullin] [BEAM-13977] [Website] change text, add capital letters

[bulat.safiullin] [BEAM-13976] [Website] add playground sass, change text-align

[bulat.safiullin] [BEAM-14040] [Website] add io connectors table

[bulat.safiullin] [BEAM-13976] [Website] add playground section, add empty line

[bulat.safiullin] [BEAM-14040] [Website] add overflow to css, add table content

[bulat.safiullin] [BEAM-14040] [Website] change ✘ for ✔, add license, add br

[bulat.safiullin] [BEAM-14040] [Website] add empty line

[bulat.safiullin] [BEAM-14040] [Website] change td

[bulat.safiullin] [BEAM-14041] [Website] update built io transforms

[bulat.safiullin] [BEAM-14041] [Website] move connectors from Miscellaneous to Database

[bulat.safiullin] [BEAM-14040] [Website] change links color

[danielamartinmtz] Updated metrics' CronJob API to use the latest batch version.

[bulat.safiullin] [BEAM-14041] [Website] change IO from go to java

[bulat.safiullin] [BEAM-14040] [Website] change links, change specific version to current

[danielamartinmtz] Updated cluster to test in metrics-upgrade-clone in BeamMetrics_Publish

[aydar.zaynutdinov] [BEAM-13976][Website]

[aydar.zaynutdinov] [BEAM-14040][Website]

[aydar.zaynutdinov] [BEAM-14041][Website]

[danielamartinmtz] Updated StateFulSet k8s obejct in cassandra-svc-statefulset.yaml file in

[danielamartinmtz] Updated documentation including cluster specs.

[noreply] Beam 13058 k8s apis upgrade - elasticsearch (#18)

[danielamartinmtz] Removed code used for testing.

[danielamartinmtz] Removed code used for testing in job_PostCommit_BeamMetrics_Publish

[noreply] Beam 13058 k8s apis upgrade - Adding Basic Auth details in documentation

[mmack] [BEAM-13232] Close clients properly in KinesisSource. Also use lazy init

[Pablo Estrada] [BEAM-14151] Excluding Spanner CDC tests from Dataflow V1 suite

[danielamartinmtz] Added comments in initContainers and remove unused code in elasticsearch

[noreply] [BEAM-14134] Optimize memory allocations for various core coders

[noreply] [BEAM-14129] Restructure PubsubLiteIO Read side to produce smaller

[noreply] [BEAM-12697] Add primitive field generation from IR to SBE extension

[noreply] [BEAM-13889] Add test cases to jsonx package (#17124)

[noreply] Remove unreachable code in container.go (#17166)

[noreply] Add ability to handle streaming input to AvroSchemaIOProvider (#17126)

[noreply] [BEAM-12898] Flink Load Tests failure- UncheckedExecutionException -

[Daniel Oliveira] Moving to 2.39.0-SNAPSHOT on master branch.


------------------------------------------
[...truncated 20.85 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648111968405469117/****\022@29da67775e68520899e1a07a873782705cd7948f66ecc24ec5ee54fb321458a2"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/24 08:52:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648111968405469117/model
2022/03/24 08:52:49 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0324070149"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648111968405469117/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648111968405469117/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0324070149",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/24 08:52:49 Submitted job: 2022-03-24_01_52_49-17158183365906219932
2022/03/24 08:52:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-24_01_52_49-17158183365906219932?project=apache-beam-testing
2022/03/24 08:52:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-24_01_52_49-17158183365906219932
2022/03/24 08:52:49 Job state: JOB_STATE_PENDING ...
2022/03/24 08:53:19 Job still running ...
2022/03/24 08:53:49 Job still running ...
2022/03/24 08:54:19 Job still running ...
2022/03/24 08:54:49 Job still running ...
2022/03/24 08:55:20 Job still running ...
2022/03/24 08:55:51 Job still running ...
2022/03/24 08:56:21 Failed to execute job: job 2022-03-24_01_52_49-17158183365906219932 failed
panic: Failed to execute job: job 2022-03-24_01_52_49-17158183365906219932 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc0000480c0, 0x10484a4, 0x19, 0xc000635e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/aon6ckswydris

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #457

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/457/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14141] Set Interactive Beam to use the default Dataproc image

[noreply] BEAM-14115 - Update find criteria limited to _id (#17102)

[chamikaramj] Disable BigQueryIOStorageWriteIT for general Java post-commit

[noreply] Revert "[BEAM-14038] Auto-startup for Python expansion service.

[noreply] Minor: Bump timeout for Java PreCommit (#17157)

[noreply] [BEAM-14152] Disable flaky

[noreply] Fixing a small bug in TypedSchemaTransformTest that caused it to flake.

[noreply] [BEAM-14116] Catch MonitoringInfoMetricName null keys or values in the

[noreply] [BEAM-14129] Restructure SubscriptionPartitionLoader to use a manual SDF

[noreply] [BEAM-13015] Avoid repeated weighing of StateKey in

[noreply] Add option to add modules to JDK add-open (#17110)

[noreply] [BEAM-13015] Clarify ownership of the list for state caching across


------------------------------------------
[...truncated 20.83 KB...]
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648025564078558422/****\022@35bab6bf535de7d4135ddc71e763eec644d676f0b71b82d1cb31bab8a35253b4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/23 08:52:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648025564078558422/model
2022/03/23 08:52:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0323065629"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648025564078558422/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648025564078558422/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0323065629",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/23 08:52:45 Submitted job: 2022-03-23_01_52_44-16829090090015408252
2022/03/23 08:52:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-23_01_52_44-16829090090015408252?project=apache-beam-testing
2022/03/23 08:52:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-23_01_52_44-16829090090015408252
2022/03/23 08:52:45 Job state: JOB_STATE_PENDING ...
2022/03/23 08:53:15 Job still running ...
2022/03/23 08:53:45 Job still running ...
2022/03/23 08:54:15 Job still running ...
2022/03/23 08:54:45 Job still running ...
2022/03/23 08:55:15 Job still running ...
2022/03/23 08:55:45 Failed to execute job: job 2022-03-23_01_52_44-16829090090015408252 failed
panic: Failed to execute job: job 2022-03-23_01_52_44-16829090090015408252 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc00012e000, 0x10484a4, 0x19, 0xc00038be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 23s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fbstoai5nehtw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #456

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/456/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-14124] Add display data to BQ storage reads.

[mmack] [adhoc] Move aws IT tests to testing package according to best practices

[noreply] fixes static checks and go lint issues (#17138)

[Kyle Weaver] Don't print in task configuration.

[noreply] [BEAM-14136] Clean up staticcheck and linter warnings in the Go SDK

[noreply] Merge pull request #17063 from [BEAM-12164] Fix flaky tests

[noreply] Revert "[BEAM-14112] Avoid storing a generator in _CustomBigQuerySource

[Kyle Weaver] [BEAM-4106] Remove filesToStage from Flink pipeline option list.

[noreply] [BEAM-14071] Enabling Flink on Dataproc for Interactive Beam (#17044)

[noreply] Minor: Bypass schema registry in schemas_test.py (#17108)


------------------------------------------
[...truncated 20.91 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647939165405172237/****\022@35bab6bf535de7d4135ddc71e763eec644d676f0b71b82d1cb31bab8a35253b4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/22 08:52:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647939165405172237/model
2022/03/22 08:52:46 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0322065332"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647939165405172237/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647939165405172237/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0322065332",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/22 08:52:46 Submitted job: 2022-03-22_01_52_46-12841360198782123360
2022/03/22 08:52:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-22_01_52_46-12841360198782123360?project=apache-beam-testing
2022/03/22 08:52:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-22_01_52_46-12841360198782123360
2022/03/22 08:52:46 Job state: JOB_STATE_PENDING ...
2022/03/22 08:53:16 Job still running ...
2022/03/22 08:53:46 Job still running ...
2022/03/22 08:54:16 Job still running ...
2022/03/22 08:54:46 Job still running ...
2022/03/22 08:55:16 Job still running ...
2022/03/22 08:55:46 Job still running ...
2022/03/22 08:56:17 Failed to execute job: job 2022-03-22_01_52_46-12841360198782123360 failed
panic: Failed to execute job: job 2022-03-22_01_52_46-12841360198782123360 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc0000480c0, 0x10484a4, 0x19, 0xc00054be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fkiqcd7aktfh6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #455

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/455/display/redirect>

Changes:


------------------------------------------
[...truncated 20.77 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647852750788410245/****\022@a54e4637b64c068c2d9aff0a041a03939ac646081324354a0579cd35f55790b8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/21 08:52:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647852750788410245/model
2022/03/21 08:52:31 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0321065329"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647852750788410245/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647852750788410245/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0321065329",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/21 08:52:32 Submitted job: 2022-03-21_01_52_31-17395564904212406982
2022/03/21 08:52:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-21_01_52_31-17395564904212406982?project=apache-beam-testing
2022/03/21 08:52:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-21_01_52_31-17395564904212406982
2022/03/21 08:52:32 Job state: JOB_STATE_PENDING ...
2022/03/21 08:53:02 Job still running ...
2022/03/21 08:53:32 Job still running ...
2022/03/21 08:54:02 Job still running ...
2022/03/21 08:54:32 Job still running ...
2022/03/21 08:55:02 Job still running ...
2022/03/21 08:55:32 Job still running ...
2022/03/21 08:56:02 Failed to execute job: job 2022-03-21_01_52_31-17395564904212406982 failed
panic: Failed to execute job: job 2022-03-21_01_52_31-17395564904212406982 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc0000480c0, 0x10484a4, 0x19, 0xc0003f7e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/nxtpux7fraw4e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #454

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/454/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14122] Upgrade pip-licenses dependency (#17132)


------------------------------------------
[...truncated 20.80 KB...]
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647766358543288668/****\022@a54e4637b64c068c2d9aff0a041a03939ac646081324354a0579cd35f55790b8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/20 08:52:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647766358543288668/model
2022/03/20 08:52:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0320065328"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647766358543288668/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647766358543288668/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0320065328",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/20 08:52:39 Submitted job: 2022-03-20_01_52_39-14350899597456576229
2022/03/20 08:52:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-20_01_52_39-14350899597456576229?project=apache-beam-testing
2022/03/20 08:52:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-20_01_52_39-14350899597456576229
2022/03/20 08:52:39 Job state: JOB_STATE_PENDING ...
2022/03/20 08:53:09 Job still running ...
2022/03/20 08:53:39 Job still running ...
2022/03/20 08:54:09 Job still running ...
2022/03/20 08:54:39 Job still running ...
2022/03/20 08:55:09 Job still running ...
2022/03/20 08:55:39 Failed to execute job: job 2022-03-20_01_52_39-14350899597456576229 failed
panic: Failed to execute job: job 2022-03-20_01_52_39-14350899597456576229 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc0000480c0, 0x10484a4, 0x19, 0xc0003fde00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/v5vpw2yerbp7q

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #453

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/453/display/redirect?page=changes>

Changes:

[Kiley Sok] Add Java 17 Nexmark metrics to Grafana

[yiru] .

[yiru] .

[yiru] .

[yiru] format fix

[yiru] .

[yiru] make DoFn into a separate class

[yiru] .

[yiru] fix setting

[mmack] [adhoc] Minor cleanup for aws2 tests

[mmack] [BEAM-14125] Update website IO matrix to recommend aws2 IOs

[noreply] [BEAM-14128] Eliminating quadratic behavior of

[noreply] [BEAM-13972] Add RunInference interface (#16917)

[noreply] Merge pull request #17116 from [BEAM-12164] Remove change_stream in

[yiru] fix checkstyle

[yiru] spotlessapply

[noreply] Deprecate tags.go (#17025)

[noreply] [BEAM-12753] and [BEAM-12815] Fix Flink Integration Tests (#17067)

[noreply] Merge pull request #16895 from [BEAM-13882][Playground] More tests for

[noreply] [BEAM-13925] Add weekly automation to update our reviewer config

[noreply] Merge pull request #17076 from Beam 14082 update payground for mobile

[noreply] [BEAM-13925] Assign committers in the scheduled action (#17062)

[noreply] Pin setup-gcloud to v0 instead of master (#17123)

[noreply] [BEAM-3304] documentation for PaneInfo in BPG (#17047)

[noreply] Merge pull request #17016 from [BEAM-14049][Playground] Add new API

[noreply] Merge pull request #17077 from [BEAM-14078] [Website] change link

[noreply] Merge pull request #17085 from [BEAM-14077] [Website] add beam

[noreply] Update Changes.md w/Go pipeline pre-process fix.

[noreply] [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088)

[noreply] Merge pull request #17023 from [BEAM-12164]: Remove child partition


------------------------------------------
[...truncated 20.77 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647679958730953552/****\022@a54e4637b64c068c2d9aff0a041a03939ac646081324354a0579cd35f55790b8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/19 08:52:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647679958730953552/model
2022/03/19 08:52:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0319065359"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647679958730953552/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647679958730953552/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0319065359",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/19 08:52:39 Submitted job: 2022-03-19_01_52_39-2443493505907352562
2022/03/19 08:52:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-19_01_52_39-2443493505907352562?project=apache-beam-testing
2022/03/19 08:52:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-19_01_52_39-2443493505907352562
2022/03/19 08:52:40 Job state: JOB_STATE_PENDING ...
2022/03/19 08:53:10 Job still running ...
2022/03/19 08:53:40 Job still running ...
2022/03/19 08:54:10 Job still running ...
2022/03/19 08:54:40 Job still running ...
2022/03/19 08:55:10 Job still running ...
2022/03/19 08:55:40 Job still running ...
2022/03/19 08:56:10 Failed to execute job: job 2022-03-19_01_52_39-2443493505907352562 failed
panic: Failed to execute job: job 2022-03-19_01_52_39-2443493505907352562 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc0000480c0, 0x10484a4, 0x19, 0xc00042be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dxwaavkaf35rk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #452

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/452/display/redirect?page=changes>

Changes:

[Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage.

[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner

[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)

[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,

[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.

[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource (#17100)

[noreply] Populate environment capabilities in v1beta3 protos. (#17042)

[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in BQ IO.

[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on Dataflow,

[noreply] [BEAM-14038] Auto-startup for Python expansion service. (#17035)

[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.

[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)

[noreply] Merge pull request #16977 from [BEAM-12164]  Added integration test for


------------------------------------------
[...truncated 20.85 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647593555955830085/****\022@d13a2ac621970078f744d2752c4258f4eecbfc926484b99ca35a5a52b98f525a"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/18 08:52:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647593555955830085/model
2022/03/18 08:52:36 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0318065340"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647593555955830085/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647593555955830085/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0318065340",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/18 08:52:37 Submitted job: 2022-03-18_01_52_36-16416509814932768960
2022/03/18 08:52:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-18_01_52_36-16416509814932768960?project=apache-beam-testing
2022/03/18 08:52:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-18_01_52_36-16416509814932768960
2022/03/18 08:52:37 Job state: JOB_STATE_PENDING ...
2022/03/18 08:53:07 Job still running ...
2022/03/18 08:53:37 Job still running ...
2022/03/18 08:54:07 Job still running ...
2022/03/18 08:54:37 Job still running ...
2022/03/18 08:55:07 Job still running ...
2022/03/18 08:55:37 Job still running ...
2022/03/18 08:56:07 Job still running ...
2022/03/18 08:56:37 Failed to execute job: job 2022-03-18_01_52_36-16416509814932768960 failed
panic: Failed to execute job: job 2022-03-18_01_52_36-16416509814932768960 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c5c8, 0xc0000480c0, 0x10484a4, 0x19, 0xc000315e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rttib7k4rd46y

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #451

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/451/display/redirect?page=changes>

Changes:

[noreply] Mapped JOB_STATE_RESOURCE_CLEANING_UP to State.RUNNING.

[ryanthompson591] fixed typo in typehints

[zyichi] Remove unused prebuild_sdk_container_base_iamge option from validate

[hengfeng] feat: add more custom metrics

[noreply] [BEAM-14103][Playgrounf][Bugfix] Fix google analytics id (#17092)

[noreply] Minor: Make ScopedReadStateSupplier final (#16992)

[noreply] [BEAM-14113] Improve SamzaJobServerDriver extensibility (#17099)

[noreply] [BEAM-14116] Chunk commit requests dynamically (#17004)

[noreply] Merge pull request #17079 from [BEAM-13660] Add types and queries in

[noreply] [BEAM-13888] Add unit testing to ioutilx (#17058)

[noreply] Merge pull request #16822 from [BEAM-13841][Playground] Add Application

[noreply] Minor: Make serializableCoder warning gramatically correct english

[noreply] [BEAM-14091] Fixing Interactive Beam show/collect for remote runners


------------------------------------------
[...truncated 20.81 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647507151675711071/****\022@1014981e2ccf3a153113c8e959fc11edbe43120502a672339d3970934c7c26c8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/17 08:52:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647507151675711071/model
2022/03/17 08:52:32 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0317065340"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647507151675711071/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647507151675711071/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0317065340",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/17 08:52:33 Submitted job: 2022-03-17_01_52_32-6797917078589734073
2022/03/17 08:52:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-17_01_52_32-6797917078589734073?project=apache-beam-testing
2022/03/17 08:52:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-17_01_52_32-6797917078589734073
2022/03/17 08:52:33 Job state: JOB_STATE_PENDING ...
2022/03/17 08:53:03 Job still running ...
2022/03/17 08:53:33 Job still running ...
2022/03/17 08:54:03 Job still running ...
2022/03/17 08:54:33 Job still running ...
2022/03/17 08:55:03 Job still running ...
2022/03/17 08:55:33 Job still running ...
2022/03/17 08:56:03 Failed to execute job: job 2022-03-17_01_52_32-6797917078589734073 failed
panic: Failed to execute job: job 2022-03-17_01_52_32-6797917078589734073 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c4e8, 0xc0000480c0, 0x10483c4, 0x19, 0xc00067be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 40s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/c5hzcjncrjhta

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #450

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/450/display/redirect?page=changes>

Changes:

[Chamikara Madhusanka Jayalath] Updates x-lang release validation to use staged jars

[dhuntsperger] documented maven-to-gradle conversion for Dataflow; refactored java

[dhuntsperger] adding a list of example pipelines

[dhuntsperger] removing unnecessary `ls` command from maven project generation

[mmack] [BEAM-13175] Add KinesisIO.write for AWS SDK v2.

[dhuntsperger] fixing filename formatting in response to feedback

[dhuntsperger] adding extra step emphasizing runner setupt

[dhuntsperger] reorganized instructions to emphasize setup steps for runners

[mmack] [BEAM-13175] Document changes to IOs in amazon-web-services2 for AWS

[noreply] [BEAM-13767] Move a bunch of python tasks to use gradle configuration…

[noreply] Merge pull request #17052 from [BEAM-13818] [SnowflakeIO] Add support

[noreply] Adding pydoc for StateHandler (#17091)

[noreply] BEAM-3165 Bypass split if numSplit is zero (#17084)


------------------------------------------
[...truncated 20.81 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647420748027597123/****\022@1014981e2ccf3a153113c8e959fc11edbe43120502a672339d3970934c7c26c8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/16 08:52:28 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647420748027597123/model
2022/03/16 08:52:28 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0316065335"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647420748027597123/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647420748027597123/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0316065335",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/16 08:52:29 Submitted job: 2022-03-16_01_52_28-12452831765359551440
2022/03/16 08:52:29 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-16_01_52_28-12452831765359551440?project=apache-beam-testing
2022/03/16 08:52:29 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-16_01_52_28-12452831765359551440
2022/03/16 08:52:29 Job state: JOB_STATE_PENDING ...
2022/03/16 08:52:59 Job still running ...
2022/03/16 08:53:29 Job still running ...
2022/03/16 08:53:59 Job still running ...
2022/03/16 08:54:29 Job still running ...
2022/03/16 08:54:59 Job still running ...
2022/03/16 08:55:29 Job still running ...
2022/03/16 08:56:00 Failed to execute job: job 2022-03-16_01_52_28-12452831765359551440 failed
panic: Failed to execute job: job 2022-03-16_01_52_28-12452831765359551440 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c4e8, 0xc00012e000, 0x10483c4, 0x19, 0xc0004c9e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lswt24tlmdknk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #449

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/449/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test

[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test

[benjamin.gonzalez] [BEAM-12572] Add java examples tests

[benjamin.gonzalez] [BEAM-12572] Change tests collected by runner

[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions, skip tests for specific runners

[benjamin.gonzalez] [BEAM-12572] Skip failing tests

[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warnings

[benjamin.gonzalez] [BEAM-12572] Skip tfidf tests on direct runner

[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions

[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warning

[benjamin.gonzalez] [BEAM-12572] Enable test with Pipeline serialization error fixed, link

[benjamin.gonzalez] [BEAM-12572] Sickbay TfIdf test for DirectRunner

[benjamin.gonzalez] [BEAM-12572] Refactor naming for BigQueryClient

[mmack] [adhoc] Update owners for aws modules

[noreply] [BEAM-14051] Add a warning to gradle.properties that many Beam modules

[noreply] Merge pull request #17000 from [BEAM-13881] [Playground] Increase test

[noreply] Add deterministic dict coding via key sorting. (#17037)

[noreply] Merge pull request #17054 from [BEAM-14075] [SnowflakeIO] Change a


------------------------------------------
[...truncated 20.90 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647334362618824872/****\022@1014981e2ccf3a153113c8e959fc11edbe43120502a672339d3970934c7c26c8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/15 08:52:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647334362618824872/model
2022/03/15 08:52:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0315065325"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647334362618824872/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647334362618824872/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0315065325",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/15 08:52:44 Submitted job: 2022-03-15_01_52_43-14616666073606103583
2022/03/15 08:52:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-15_01_52_43-14616666073606103583?project=apache-beam-testing
2022/03/15 08:52:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-15_01_52_43-14616666073606103583
2022/03/15 08:52:44 Job state: JOB_STATE_PENDING ...
2022/03/15 08:53:14 Job still running ...
2022/03/15 08:53:44 Job still running ...
2022/03/15 08:54:14 Job still running ...
2022/03/15 08:54:44 Job still running ...
2022/03/15 08:55:14 Job still running ...
2022/03/15 08:55:44 Job still running ...
2022/03/15 08:56:14 Failed to execute job: job 2022-03-15_01_52_43-14616666073606103583 failed
panic: Failed to execute job: job 2022-03-15_01_52_43-14616666073606103583 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c4e8, 0xc0000480c0, 0x10483c4, 0x19, 0xc0004d7e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/cqz3xsd72cewc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #448

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/448/display/redirect>

Changes:


------------------------------------------
[...truncated 20.87 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647247959199649370/****\022@1014981e2ccf3a153113c8e959fc11edbe43120502a672339d3970934c7c26c8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/14 08:52:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647247959199649370/model
2022/03/14 08:52:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0314065331"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647247959199649370/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647247959199649370/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0314065331",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/14 08:52:40 Submitted job: 2022-03-14_01_52_39-4757651741422212893
2022/03/14 08:52:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-14_01_52_39-4757651741422212893?project=apache-beam-testing
2022/03/14 08:52:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-14_01_52_39-4757651741422212893
2022/03/14 08:52:40 Job state: JOB_STATE_PENDING ...
2022/03/14 08:53:12 Job still running ...
2022/03/14 08:53:42 Job still running ...
2022/03/14 08:54:12 Job still running ...
2022/03/14 08:54:42 Job still running ...
2022/03/14 08:55:12 Job still running ...
2022/03/14 08:55:42 Job still running ...
2022/03/14 08:56:13 Failed to execute job: job 2022-03-14_01_52_39-4757651741422212893 failed
panic: Failed to execute job: job 2022-03-14_01_52_39-4757651741422212893 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c4e8, 0xc0000480c0, 0x10483c4, 0x19, 0xc0004c3e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mi3oatsos7ym4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #447

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/447/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14072] [BEAM-13993] [BEAM-10039] Import beam plugins before


------------------------------------------
[...truncated 20.87 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647161557006981224/****\022@1014981e2ccf3a153113c8e959fc11edbe43120502a672339d3970934c7c26c8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/13 08:52:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647161557006981224/model
2022/03/13 08:52:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0313065323"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647161557006981224/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647161557006981224/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0313065323",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/13 08:52:38 Submitted job: 2022-03-13_00_52_37-13134368065738560201
2022/03/13 08:52:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-13_00_52_37-13134368065738560201?project=apache-beam-testing
2022/03/13 08:52:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-13_00_52_37-13134368065738560201
2022/03/13 08:52:38 Job state: JOB_STATE_PENDING ...
2022/03/13 08:53:08 Job still running ...
2022/03/13 08:53:38 Job still running ...
2022/03/13 08:54:08 Job still running ...
2022/03/13 08:54:38 Job still running ...
2022/03/13 08:55:08 Job still running ...
2022/03/13 08:55:38 Job still running ...
2022/03/13 08:56:08 Failed to execute job: job 2022-03-13_00_52_37-13134368065738560201 failed
panic: Failed to execute job: job 2022-03-13_00_52_37-13134368065738560201 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c4e8, 0xc00012e000, 0x10483c4, 0x19, 0xc0003d3e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/p6qbv4jjralbg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #446

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/446/display/redirect?page=changes>

Changes:

[Ismaël Mejía] [BEAM-13981] Remove Spark Runner specific code for event logging

[vitaly.terentyev] [BEAM-2766] Support null key/values in HadoopFormatIO

[vitaly.terentyev] [BEAM-2766] Fix checkstyle


------------------------------------------
[...truncated 20.86 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647075161787051620/****\022@1014981e2ccf3a153113c8e959fc11edbe43120502a672339d3970934c7c26c8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/12 08:52:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647075161787051620/model
2022/03/12 08:52:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0312065328"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647075161787051620/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647075161787051620/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0312065328",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/12 08:52:43 Submitted job: 2022-03-12_00_52_42-17959260888798602324
2022/03/12 08:52:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-12_00_52_42-17959260888798602324?project=apache-beam-testing
2022/03/12 08:52:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-12_00_52_42-17959260888798602324
2022/03/12 08:52:43 Job state: JOB_STATE_PENDING ...
2022/03/12 08:53:13 Job still running ...
2022/03/12 08:53:43 Job still running ...
2022/03/12 08:54:13 Job still running ...
2022/03/12 08:54:43 Job still running ...
2022/03/12 08:55:13 Job still running ...
2022/03/12 08:55:43 Job still running ...
2022/03/12 08:56:13 Failed to execute job: job 2022-03-12_00_52_42-17959260888798602324 failed
panic: Failed to execute job: job 2022-03-12_00_52_42-17959260888798602324 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c4e8, 0xc0000480c0, 0x10483c4, 0x19, 0xc000417e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rg7sm77o4dw7e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #445

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/445/display/redirect?page=changes>

Changes:

[ihr] [BEAM-13923] Fix the answers placeholders locations in the Java katas

[jakub.kukul] [BEAM-14039] Propagate ignore_unknown_columns parameter.

[stranniknm] [BEAM-14079] playground - improve accessibility

[noreply] [BEAM-13925] Find and address prs that havent been reviewed in a week

[noreply] Fix import path

[noreply] [BEAM-13925] Fix one more import path

[noreply] Add a StatefulDoFn test that sets event time timer within allowed

[noreply] Merge pull request #17056 from [BEAM-14076] [SnowflakeIO] Add support


------------------------------------------
[...truncated 20.93 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646988762635505211/****\022@1014981e2ccf3a153113c8e959fc11edbe43120502a672339d3970934c7c26c8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/11 08:52:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646988762635505211/model
2022/03/11 08:52:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0311065332"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646988762635505211/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646988762635505211/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0311065332",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/11 08:52:43 Submitted job: 2022-03-11_00_52_43-4471574673305669454
2022/03/11 08:52:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-11_00_52_43-4471574673305669454?project=apache-beam-testing
2022/03/11 08:52:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-11_00_52_43-4471574673305669454
2022/03/11 08:52:43 Job state: JOB_STATE_PENDING ...
2022/03/11 08:53:13 Job still running ...
2022/03/11 08:53:44 Job still running ...
2022/03/11 08:54:14 Job still running ...
2022/03/11 08:54:44 Job still running ...
2022/03/11 08:55:14 Job still running ...
2022/03/11 08:55:44 Job still running ...
2022/03/11 08:56:14 Job still running ...
2022/03/11 08:56:44 Job still running ...
2022/03/11 08:57:14 Job still running ...
2022/03/11 08:57:44 Job still running ...
2022/03/11 08:58:14 Failed to execute job: job 2022-03-11_00_52_43-4471574673305669454 failed
panic: Failed to execute job: job 2022-03-11_00_52_43-4471574673305669454 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c4e8, 0xc00012e000, 0x10483c4, 0x19, 0xc000453e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6io364plvkkhm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #444

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/444/display/redirect?page=changes>

Changes:

[hengfeng] [BEAM-12164]: display the metadata table's name on UI

[noreply] Revert "[BEAM-13993] [BEAM-10039] Import beam plugins before starting

[noreply] Merge pull request #17036 from [BEAM-12164] Convert all static instances

[noreply] fix variable reference (#16991)

[noreply] Merge pull request #16844 from [BEAM-12164]: allow for nanosecond

[noreply] [BEAM-13904] Increase unit testing in the reflectx package (#17024)


------------------------------------------
[...truncated 20.89 KB...]
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646902455410631233/****\022@1014981e2ccf3a153113c8e959fc11edbe43120502a672339d3970934c7c26c8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/10 08:54:16 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646902455410631233/model
2022/03/10 08:54:16 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0308200134"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646902455410631233/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646902455410631233/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0308200134",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/10 08:54:17 Submitted job: 2022-03-10_00_54_16-15303547665010529794
2022/03/10 08:54:17 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-10_00_54_16-15303547665010529794?project=apache-beam-testing
2022/03/10 08:54:17 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-10_00_54_16-15303547665010529794
2022/03/10 08:54:17 Job state: JOB_STATE_PENDING ...
2022/03/10 08:54:47 Job still running ...
2022/03/10 08:55:17 Job still running ...
2022/03/10 08:55:47 Job still running ...
2022/03/10 08:56:17 Job still running ...
2022/03/10 08:56:47 Job still running ...
2022/03/10 08:57:17 Failed to execute job: job 2022-03-10_00_54_16-15303547665010529794 failed
panic: Failed to execute job: job 2022-03-10_00_54_16-15303547665010529794 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c4e8, 0xc000126000, 0x10483c4, 0x19, 0xc000353e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 12s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ktrb4ibkg45kc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #443

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/443/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Update dataflow API client.

[Robert Bradshaw] Instructions for updating apitools generated files.

[noreply] Merge pull request #17027: [BEAM-11205] Upgrade GCP Libraries BOM

[noreply] [BEAM-13709] Inconsistent behavior when parsing boolean flags across

[noreply] [BEAM-10976] Bundle finalization: Harness and some exec changes (#16980)

[noreply] Merge pull request #16976 from [BEAM-14010] [Website] Add Playground

[noreply] [BEAM-12447] Upgrade cloud build client and add/cleanup options (#17032)


------------------------------------------
[...truncated 20.92 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646815971279973623/****\022@1014981e2ccf3a153113c8e959fc11edbe43120502a672339d3970934c7c26c8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/09 08:52:52 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646815971279973623/model
2022/03/09 08:52:52 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0308200134"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646815971279973623/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646815971279973623/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0308200134",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/09 08:52:52 Submitted job: 2022-03-09_00_52_52-1729234606138877131
2022/03/09 08:52:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-09_00_52_52-1729234606138877131?project=apache-beam-testing
2022/03/09 08:52:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-09_00_52_52-1729234606138877131
2022/03/09 08:52:52 Job state: JOB_STATE_PENDING ...
2022/03/09 08:53:22 Job still running ...
2022/03/09 08:53:52 Job still running ...
2022/03/09 08:54:22 Job still running ...
2022/03/09 08:54:52 Job still running ...
2022/03/09 08:55:22 Job still running ...
2022/03/09 08:55:53 Job still running ...
2022/03/09 08:56:23 Job still running ...
2022/03/09 08:56:53 Job still running ...
2022/03/09 08:57:23 Job still running ...
2022/03/09 08:57:53 Job still running ...
2022/03/09 08:58:23 Failed to execute job: job 2022-03-09_00_52_52-1729234606138877131 failed
panic: Failed to execute job: job 2022-03-09_00_52_52-1729234606138877131 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115c4e8, 0xc0000480c0, 0x10483c4, 0x19, 0xc00042fe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wzelhfchtqcy6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #442

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/442/display/redirect?page=changes>

Changes:

[dannymccormick] [BEAM-11085] Test that windows are correctly observed in DoFns

[jrmccluskey] [BEAM-14050] Update taxi.go example instructions

[noreply] Give pr bot write permissions on pr update

[noreply] Adding a logical type for Schemas using proto serialization. (#16940)

[noreply] BEAM-13765 missing PAssert methods (#16668)

[noreply] [BEAM-13909] improve coverage of Provision package (#17014)


------------------------------------------
[...truncated 20.83 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646729554654493448/****\022@a6d189cbaacc5640e5b3805fd8c55506525ce1012234a40503e49901687f762b"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/08 08:52:35 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646729554654493448/model
2022/03/08 08:52:35 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0308065341"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646729554654493448/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646729554654493448/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0308065341",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/08 08:52:35 Submitted job: 2022-03-08_00_52_35-2621617130495631640
2022/03/08 08:52:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-08_00_52_35-2621617130495631640?project=apache-beam-testing
2022/03/08 08:52:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-08_00_52_35-2621617130495631640
2022/03/08 08:52:36 Job state: JOB_STATE_PENDING ...
2022/03/08 08:53:06 Job still running ...
2022/03/08 08:53:36 Job still running ...
2022/03/08 08:54:06 Job still running ...
2022/03/08 08:54:36 Job still running ...
2022/03/08 08:55:06 Job still running ...
2022/03/08 08:55:36 Job still running ...
2022/03/08 08:56:06 Job still running ...
2022/03/08 08:56:36 Job still running ...
2022/03/08 08:57:06 Job still running ...
2022/03/08 08:57:36 Job still running ...
2022/03/08 08:58:06 Failed to execute job: job 2022-03-08_00_52_35-2621617130495631640 failed
panic: Failed to execute job: job 2022-03-08_00_52_35-2621617130495631640 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x10467a4, 0x19, 0xc00053be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 43s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/queacxc7vfgq4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #441

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/441/display/redirect?page=changes>

Changes:

[noreply] [BEAM-13925] Add ability to get metrics on pr-bot performance (#16985)


------------------------------------------
[...truncated 20.87 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646643156335672825/****\022@a6d189cbaacc5640e5b3805fd8c55506525ce1012234a40503e49901687f762b"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/07 08:52:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646643156335672825/model
2022/03/07 08:52:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0307065338"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646643156335672825/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646643156335672825/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0307065338",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/07 08:52:37 Submitted job: 2022-03-07_00_52_37-1886076169341494530
2022/03/07 08:52:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-07_00_52_37-1886076169341494530?project=apache-beam-testing
2022/03/07 08:52:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-07_00_52_37-1886076169341494530
2022/03/07 08:52:37 Job state: JOB_STATE_PENDING ...
2022/03/07 08:53:07 Job still running ...
2022/03/07 08:53:37 Job still running ...
2022/03/07 08:54:07 Job still running ...
2022/03/07 08:54:37 Job still running ...
2022/03/07 08:55:07 Job still running ...
2022/03/07 08:55:37 Job still running ...
2022/03/07 08:56:08 Failed to execute job: job 2022-03-07_00_52_37-1886076169341494530 failed
panic: Failed to execute job: job 2022-03-07_00_52_37-1886076169341494530 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x10467a4, 0x19, 0xc0001dfe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/53jg74kyh7s4y

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #440

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/440/display/redirect>

Changes:


------------------------------------------
[...truncated 20.92 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646580101721972952/****\022@a6d189cbaacc5640e5b3805fd8c55506525ce1012234a40503e49901687f762b"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/06 15:21:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646580101721972952/model
2022/03/06 15:21:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0306143519"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646580101721972952/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646580101721972952/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0306143519",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/06 15:21:43 Submitted job: 2022-03-06_07_21_42-8198288090301015754
2022/03/06 15:21:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-06_07_21_42-8198288090301015754?project=apache-beam-testing
2022/03/06 15:21:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-06_07_21_42-8198288090301015754
2022/03/06 15:21:43 Job state: JOB_STATE_PENDING ...
2022/03/06 15:22:13 Job still running ...
2022/03/06 15:22:43 Job still running ...
2022/03/06 15:23:13 Job still running ...
2022/03/06 15:23:43 Job still running ...
2022/03/06 15:24:13 Job still running ...
2022/03/06 15:24:43 Job still running ...
2022/03/06 15:25:13 Failed to execute job: job 2022-03-06_07_21_42-8198288090301015754 failed
panic: Failed to execute job: job 2022-03-06_07_21_42-8198288090301015754 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x10467a4, 0x19, 0xc00076be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 57s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gmyaofxax3vy2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #439

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/439/display/redirect?page=changes>

Changes:

[rahuliyer573] py: Import beam plugins before starting SdkHarness

[stephen.patel] BEAM-14011 fix s3 filesystem multipart copy

[Valentyn Tymofieiev] Bump numpy bound to include 1.22 and regenerate container deps.

[github-actions] [BEAM-13925] months in date constructor are 0 indexed

[noreply] Merge pull request #16842 from [BEAM-13932][Playground] Container's user

[noreply] Doc updates and blog post for 2.37.0 (#16887)

[noreply] Remove resolved issue in docs + update class path on sample (#17018)

[noreply] [BEAM-14016] Fixed flaky postcommit test (#17009)

[noreply] Remove resolved issue in notebook

[noreply] [BEAM-13947] Add split() and rsplit(), non-deferred column operations on

[noreply] BEAM-14026 - Fixes bug related to Unnesting nested rows in an array


------------------------------------------
[...truncated 20.87 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646470358307342214/****\022@a6d189cbaacc5640e5b3805fd8c55506525ce1012234a40503e49901687f762b"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/05 08:52:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646470358307342214/model
2022/03/05 08:52:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0305065333"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646470358307342214/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646470358307342214/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0305065333",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/05 08:52:39 Submitted job: 2022-03-05_00_52_39-7787398381964493812
2022/03/05 08:52:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-05_00_52_39-7787398381964493812?project=apache-beam-testing
2022/03/05 08:52:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-05_00_52_39-7787398381964493812
2022/03/05 08:52:39 Job state: JOB_STATE_PENDING ...
2022/03/05 08:53:09 Job still running ...
2022/03/05 08:53:39 Job still running ...
2022/03/05 08:54:09 Job still running ...
2022/03/05 08:54:39 Job still running ...
2022/03/05 08:55:09 Job still running ...
2022/03/05 08:55:40 Job still running ...
2022/03/05 08:56:10 Failed to execute job: job 2022-03-05_00_52_39-7787398381964493812 failed
panic: Failed to execute job: job 2022-03-05_00_52_39-7787398381964493812 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x10467a4, 0x19, 0xc00073de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/idpvqzat7vfek

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #438

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/438/display/redirect?page=changes>

Changes:

[stranniknm] [BEAM-13999] playground - support vertical orientation for graph

[noreply] [adhoc] Prepare aws2 ClientConfiguration for json serialization and

[noreply] Merge pull request #16879 from [BEAM-12164] Add javadocs to

[noreply] [Cleanup] Update pre-v2 go package references (#17002)

[noreply] [BEAM-13885] Add unit tests to window package (#16971)

[noreply] Merge pull request #16891 from [BEAM-13872] [Playground] Increase test

[noreply] Merge pull request #16912 from [BEAM-13878] [Playground] Increase test

[noreply] Merge pull request #16946 from [BEAM-13873] [Playground] Increase test

[noreply] [BEAM-13951] Update mass_comment.py list of Run commands (#16889)

[noreply] [BEAM-10652] Allow Clustering without Partition in BigQuery (#16578)

[noreply] [BEAM-13857] Add K:V flags for expansion service jars and addresses to


------------------------------------------
[...truncated 20.86 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646383961011915749/****\022@a6d189cbaacc5640e5b3805fd8c55506525ce1012234a40503e49901687f762b"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/04 08:52:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646383961011915749/model
2022/03/04 08:52:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0304065337"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646383961011915749/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646383961011915749/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0304065337",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/04 08:52:42 Submitted job: 2022-03-04_00_52_41-11570941821470218478
2022/03/04 08:52:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-04_00_52_41-11570941821470218478?project=apache-beam-testing
2022/03/04 08:52:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-04_00_52_41-11570941821470218478
2022/03/04 08:52:42 Job state: JOB_STATE_PENDING ...
2022/03/04 08:53:12 Job still running ...
2022/03/04 08:53:42 Job still running ...
2022/03/04 08:54:13 Job still running ...
2022/03/04 08:54:43 Job still running ...
2022/03/04 08:55:13 Job still running ...
2022/03/04 08:55:43 Job still running ...
2022/03/04 08:56:13 Failed to execute job: job 2022-03-04_00_52_41-11570941821470218478 failed
panic: Failed to execute job: job 2022-03-04_00_52_41-11570941821470218478 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x10467a4, 0x19, 0xc00041be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/iseisqregavlu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #437

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/437/display/redirect?page=changes>

Changes:

[Alexey Romanenko] Bump org.mongodb:mongo-java-driver to 3.12.10

[noreply] [BEAM-13973] Link Dataproc Flink master URLs to the InteractiveRunner

[noreply] [BEAM-13925] Turn pr bot on for go prs (#16984)

[Pablo Estrada] Skipping flaky sad-path tests for Spanner changestreams

[noreply] [BEAM-13964] Bump kotlin to 1.6.x (#16882)

[noreply] Merge pull request #16906: [BEAM-13974] Handle idle Storage Api streams

[noreply] Merge pull request #16562 from [BEAM-13051][D] Enable pylint warnings

[noreply] [BEAM-13925] A couple small pr-bot bug fixes (#16996)

[noreply] [BEAM-14029] Add getter, setter for target maven repo (#16995)

[noreply] [BEAM-13903] Improve coverage of metricsx package (#16994)

[noreply] [BEAM-13892] Improve coverage of avroio package (#16990)


------------------------------------------
[...truncated 20.87 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646297561339073967/****\022@69823d0c73cd1d5366604862f674523d131e2c0d8c0c6d7c8591effcd64badaf"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/03 08:52:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646297561339073967/model
2022/03/03 08:52:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0303065341"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646297561339073967/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646297561339073967/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0303065341",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/03 08:52:43 Submitted job: 2022-03-03_00_52_42-12341881574656418839
2022/03/03 08:52:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-03_00_52_42-12341881574656418839?project=apache-beam-testing
2022/03/03 08:52:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-03_00_52_42-12341881574656418839
2022/03/03 08:52:43 Job state: JOB_STATE_PENDING ...
2022/03/03 08:53:13 Job still running ...
2022/03/03 08:53:43 Job still running ...
2022/03/03 08:54:13 Job still running ...
2022/03/03 08:54:43 Job still running ...
2022/03/03 08:55:13 Job still running ...
2022/03/03 08:55:43 Job still running ...
2022/03/03 08:56:13 Job still running ...
2022/03/03 08:56:43 Job still running ...
2022/03/03 08:57:13 Job still running ...
2022/03/03 08:57:43 Job still running ...
2022/03/03 08:58:13 Failed to execute job: job 2022-03-03_00_52_42-12341881574656418839 failed
panic: Failed to execute job: job 2022-03-03_00_52_42-12341881574656418839 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x10467a4, 0x19, 0xc000839e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/may7kkgfzk766

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #436

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/436/display/redirect?page=changes>

Changes:

[egalpin] Use default context output rather than outputWithTimestamp for

[stranniknm] Palo Alto case study - fix link

[rogelio.hernandez] [BEAM-12777] Removed current docs version redirect

[noreply] Merge pull request #16850: [BEAM-11205] Upgrade Libraries BOM

[noreply] Merge pull request #16484 from [BEAM-13633] [Playground] Implement

[noreply] Add 2022 events blog post (#16975)

[noreply] Clean up Go formatter suggestions (#16973)

[noreply] [BEAM-14012] Add go fmt to Github Actions (#16978)

[noreply] [BEAM-13911] Add basic tests to Go direct runner. (#16979)

[noreply] [BEAM-13960] Add support for more types when converting from between row


------------------------------------------
[...truncated 20.80 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646211152823080445/****\022@1fd4745db2548324ae3086c3e5f2cfa07d0bcee859101e7adb2c85d1b09c7bcc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/02 08:52:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646211152823080445/model
2022/03/02 08:52:33 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0302065338"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646211152823080445/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646211152823080445/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0302065338",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/02 08:52:36 Submitted job: 2022-03-02_00_52_33-16514301168449720990
2022/03/02 08:52:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-02_00_52_33-16514301168449720990?project=apache-beam-testing
2022/03/02 08:52:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-02_00_52_33-16514301168449720990
2022/03/02 08:52:36 Job state: JOB_STATE_PENDING ...
2022/03/02 08:53:06 Job still running ...
2022/03/02 08:53:36 Job still running ...
2022/03/02 08:54:06 Job still running ...
2022/03/02 08:54:36 Job still running ...
2022/03/02 08:55:06 Job still running ...
2022/03/02 08:55:36 Job still running ...
2022/03/02 08:56:06 Failed to execute job: job 2022-03-02_00_52_33-16514301168449720990 failed
panic: Failed to execute job: job 2022-03-02_00_52_33-16514301168449720990 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2a8, 0xc00012e000, 0x1046764, 0x19, 0xc000527e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 45s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jrhrhcvbshjbs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #435

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/435/display/redirect?page=changes>

Changes:

[noreply] Build wheels for Python 3.9

[noreply] Merge pull request #16892 from [BEAM-13755] [Playground] Scroll the

[noreply] Merge pull request #16880 from [BEAM-13963][Playground] Get bucket name

[noreply] Merge pull request #16870 from [BEAM-13874][Playground] Tag multifile

[noreply] Merge pull request #16910 from [BEAM-13724] [Playground] Get the default

[noreply] [BEAM-14008] Fix incorrect guava import (#16966)

[noreply] Fix ignored exception in BatchSpannerRead. (#16960)

[noreply] [BEAM-13917] Improve coverage of databaseio package (#16956)

[noreply] [BEAM-13925] Add entry files to process new prs and pr updates for PR

[noreply] [BEAM-13899] Improve coverage of debug package (#16951)

[noreply] [BEAM-13907] Improve coverage of textio package (#16937)

[noreply] [BEAM-9150] Fix beam_PostRelease_Python_Candidate (python RC validation


------------------------------------------
[...truncated 20.86 KB...]
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646124753602250000/****\022@1fd4745db2548324ae3086c3e5f2cfa07d0bcee859101e7adb2c85d1b09c7bcc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/01 08:52:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646124753602250000/model
2022/03/01 08:52:34 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0301065338"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646124753602250000/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646124753602250000/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0301065338",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/01 08:52:35 Submitted job: 2022-03-01_00_52_34-16315973767537227438
2022/03/01 08:52:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-01_00_52_34-16315973767537227438?project=apache-beam-testing
2022/03/01 08:52:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-01_00_52_34-16315973767537227438
2022/03/01 08:52:35 Job state: JOB_STATE_PENDING ...
2022/03/01 08:53:05 Job still running ...
2022/03/01 08:53:35 Job still running ...
2022/03/01 08:54:05 Job still running ...
2022/03/01 08:54:35 Job still running ...
2022/03/01 08:55:05 Job still running ...
2022/03/01 08:55:35 Job still running ...
2022/03/01 08:56:05 Job still running ...
2022/03/01 08:56:35 Job still running ...
2022/03/01 08:57:05 Job still running ...
2022/03/01 08:57:35 Job still running ...
2022/03/01 08:58:05 Job still running ...
2022/03/01 08:58:35 Failed to execute job: job 2022-03-01_00_52_34-16315973767537227438 failed
panic: Failed to execute job: job 2022-03-01_00_52_34-16315973767537227438 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2a8, 0xc00012e000, 0x1046764, 0x19, 0xc0003bfe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 12s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/umapoglpi7hk4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #434

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/434/display/redirect>

Changes:


------------------------------------------
[...truncated 20.92 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646038360608656037/****\022@1fd4745db2548324ae3086c3e5f2cfa07d0bcee859101e7adb2c85d1b09c7bcc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/28 08:52:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646038360608656037/model
2022/02/28 08:52:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0228065328"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646038360608656037/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646038360608656037/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0228065328",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/28 08:52:41 Submitted job: 2022-02-28_00_52_41-8039652936075374787
2022/02/28 08:52:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-28_00_52_41-8039652936075374787?project=apache-beam-testing
2022/02/28 08:52:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-28_00_52_41-8039652936075374787
2022/02/28 08:52:41 Job state: JOB_STATE_PENDING ...
2022/02/28 08:53:11 Job still running ...
2022/02/28 08:53:41 Job still running ...
2022/02/28 08:54:11 Job still running ...
2022/02/28 08:54:41 Job still running ...
2022/02/28 08:55:12 Job still running ...
2022/02/28 08:55:42 Job still running ...
2022/02/28 08:56:12 Job still running ...
2022/02/28 08:56:42 Job still running ...
2022/02/28 08:57:12 Job still running ...
2022/02/28 08:57:42 Job still running ...
2022/02/28 08:58:12 Failed to execute job: job 2022-02-28_00_52_41-8039652936075374787 failed
panic: Failed to execute job: job 2022-02-28_00_52_41-8039652936075374787 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2a8, 0xc0000480c0, 0x1046764, 0x19, 0xc0008c7e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5yx2eonyayfkw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #433

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/433/display/redirect>

Changes:


------------------------------------------
[...truncated 20.93 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645951964375482486/****\022@1fd4745db2548324ae3086c3e5f2cfa07d0bcee859101e7adb2c85d1b09c7bcc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/27 08:52:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645951964375482486/model
2022/02/27 08:52:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0227065330"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645951964375482486/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645951964375482486/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0227065330",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/27 08:52:45 Submitted job: 2022-02-27_00_52_45-16211046337034874969
2022/02/27 08:52:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-27_00_52_45-16211046337034874969?project=apache-beam-testing
2022/02/27 08:52:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-27_00_52_45-16211046337034874969
2022/02/27 08:52:45 Job state: JOB_STATE_PENDING ...
2022/02/27 08:53:15 Job still running ...
2022/02/27 08:53:45 Job still running ...
2022/02/27 08:54:15 Job still running ...
2022/02/27 08:54:45 Job still running ...
2022/02/27 08:55:16 Job still running ...
2022/02/27 08:55:46 Job still running ...
2022/02/27 08:56:16 Failed to execute job: job 2022-02-27_00_52_45-16211046337034874969 failed
panic: Failed to execute job: job 2022-02-27_00_52_45-16211046337034874969 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2a8, 0xc00012e000, 0x1046764, 0x19, 0xc0006f7e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5dgi4sqha52ra

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #432

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/432/display/redirect?page=changes>

Changes:

[Ankur Goenka] [BEAM-13952] Sickbaying

[noreply] Memoize some objects for timer processing to reduce overhead. (#16207)

[noreply] [BEAM-13965] Use TypeDeserializer if type information is available to

[noreply] [BEAM-13912] Add more coverage for dataflow.go (#16903)

[noreply] [BEAM-12563] swaplevel general function for dataframe and series

[noreply] [BEAM-14001] Update coder.go unit tests (#16952)

[noreply] [BEAM-13910] Improve coverage of gcsx package (#16942)

[noreply] [BEAM-13015] Use a DirectExecutor for state since we are just completing


------------------------------------------
[...truncated 20.96 KB...]
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645865558869023256/****\022@1fd4745db2548324ae3086c3e5f2cfa07d0bcee859101e7adb2c85d1b09c7bcc"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/26 08:52:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645865558869023256/model
2022/02/26 08:52:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0226065340"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645865558869023256/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645865558869023256/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0226065340",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/26 08:52:40 Submitted job: 2022-02-26_00_52_39-17083527062983942599
2022/02/26 08:52:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-26_00_52_39-17083527062983942599?project=apache-beam-testing
2022/02/26 08:52:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-26_00_52_39-17083527062983942599
2022/02/26 08:52:40 Job state: JOB_STATE_PENDING ...
2022/02/26 08:53:10 Job still running ...
2022/02/26 08:53:40 Job still running ...
2022/02/26 08:54:10 Job still running ...
2022/02/26 08:54:40 Job still running ...
2022/02/26 08:55:10 Job still running ...
2022/02/26 08:55:40 Job still running ...
2022/02/26 08:56:10 Job still running ...
2022/02/26 08:56:40 Job still running ...
2022/02/26 08:57:10 Job still running ...
2022/02/26 08:57:40 Job still running ...
2022/02/26 08:58:10 Job still running ...
2022/02/26 08:58:40 Failed to execute job: job 2022-02-26_00_52_39-17083527062983942599 failed
panic: Failed to execute job: job 2022-02-26_00_52_39-17083527062983942599 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2a8, 0xc00012e000, 0x1046764, 0x19, 0xc0008b9e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rlizs7xiaizms

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #431

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/431/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] Revert PR#16253 due errors with plugin flaky-test-handler

[noreply] Fix BoundedQueueExecutor and StreamingDataflowWorker to actually limit

[noreply] [BEAM-1857] Add Neo4jIO (#15916)

[noreply] [BEAM-13767] Migrate serveral portable runner tasks to use configuration

[noreply] [BEAM-13996] Removing 'No cluster_manager is associated with the

[noreply] [BEAM-13906] Improve coverage of errors package (#16934)

[noreply] [BEAM-13886] unit tests for trigger package (#16935)

[noreply] [BEAM-4767] Remove beam- prefix from release script tags (#16899)

[noreply] [BEAM-13866] Add small unit tests to errorx, make boolean assignment

[noreply] [BEAM-13925] Add most of the supporting files for the pr management

[noreply] Merge pull request #16846 from [BEAM-12164]: Add sad path tests for


------------------------------------------
[...truncated 20.95 KB...]
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645779159631581762/****\022@2b88550e53c104e098443c86515a2d06f594d6b32b150a9b3d166524484043c9"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/25 08:52:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645779159631581762/model
2022/02/25 08:52:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0225065331"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645779159631581762/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645779159631581762/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0225065331",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/25 08:52:40 Submitted job: 2022-02-25_00_52_40-18120227631941664410
2022/02/25 08:52:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-25_00_52_40-18120227631941664410?project=apache-beam-testing
2022/02/25 08:52:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-25_00_52_40-18120227631941664410
2022/02/25 08:52:40 Job state: JOB_STATE_PENDING ...
2022/02/25 08:53:10 Job still running ...
2022/02/25 08:53:41 Job still running ...
2022/02/25 08:54:11 Job still running ...
2022/02/25 08:54:41 Job still running ...
2022/02/25 08:55:11 Job still running ...
2022/02/25 08:55:41 Job still running ...
2022/02/25 08:56:11 Job still running ...
2022/02/25 08:56:41 Job still running ...
2022/02/25 08:57:11 Job still running ...
2022/02/25 08:57:41 Job still running ...
2022/02/25 08:58:11 Job still running ...
2022/02/25 08:58:41 Failed to execute job: job 2022-02-25_00_52_40-18120227631941664410 failed
panic: Failed to execute job: job 2022-02-25_00_52_40-18120227631941664410 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc00012e000, 0x1046764, 0x19, 0xc0002cbe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/2zi4fei25klx6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #430

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/430/display/redirect?page=changes>

Changes:

[noreply] [BEAM-12645] Fix code-cov flakes due to monorepo. (#16925)

[noreply] [BEAM-13969] Deprecate stringx package (#16884)

[noreply] Add Go badge to ReadMe (#16897)

[noreply] [BEAM-13980] Re-add method gone missing in af2f8ee6 (#16918)

[noreply] [BEAM-13884] Improve mtime package (#16924)

[noreply] Minor: Update Go API doc links (#16932)

[noreply] [BEAM-13218] Re-enable

[noreply] Merge pull request #16857 from [BEAM-13662] [Playground] Support

[noreply] Merge pull request #16826 from [BEAM-13870] [Playground] Increase test


------------------------------------------
[...truncated 20.88 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645692764800214321/****\022@1c057dc07a57c3c36376d575d45f6c0d808c42778c845c9c0a4b9ca76708d1c1"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/24 08:52:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645692764800214321/model
2022/02/24 08:52:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0224065335"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645692764800214321/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645692764800214321/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0224065335",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/24 08:52:45 Submitted job: 2022-02-24_00_52_45-15013462792301585159
2022/02/24 08:52:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-24_00_52_45-15013462792301585159?project=apache-beam-testing
2022/02/24 08:52:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-24_00_52_45-15013462792301585159
2022/02/24 08:52:46 Job state: JOB_STATE_PENDING ...
2022/02/24 08:53:16 Job still running ...
2022/02/24 08:53:46 Job still running ...
2022/02/24 08:54:16 Job still running ...
2022/02/24 08:54:46 Job still running ...
2022/02/24 08:55:16 Job still running ...
2022/02/24 08:55:46 Job still running ...
2022/02/24 08:56:16 Failed to execute job: job 2022-02-24_00_52_45-15013462792301585159 failed
panic: Failed to execute job: job 2022-02-24_00_52_45-15013462792301585159 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x1046764, 0x19, 0xc00044fe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/2quwdpkceflsy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #429

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/429/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-13796] projection pushdown in BQ IO

[Kyle Weaver] [BEAM-13796] Move test to ReadTest class and correct javadoc for

[Kyle Weaver] [BEAM-13796] Pushdown is not supported on TypedRead#fromQuery.

[noreply] [BEAM-13738] Reenable ignored SQS test after bumping elasticmq for fixed

[noreply] fix build status link (#16907)

[noreply] Merge pull request #16549 from [BEAM-13681][Playground] Refactoring

[noreply] Merge pull request #16732 from [BEAM-13825] [Playground] updated

[noreply] Merge pull request #16683 from [BEAM-13713][Playground] Java graph

[noreply] case study pages - improvements and fixes (#16896)

[noreply] Palo Alto case study (#16915)


------------------------------------------
[...truncated 20.76 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645606350424005658/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/23 08:52:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645606350424005658/model
2022/02/23 08:52:31 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0223065327"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645606350424005658/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645606350424005658/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0223065327",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/23 08:52:31 Submitted job: 2022-02-23_00_52_31-3260921882254758861
2022/02/23 08:52:31 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-23_00_52_31-3260921882254758861?project=apache-beam-testing
2022/02/23 08:52:31 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-23_00_52_31-3260921882254758861
2022/02/23 08:52:31 Job state: JOB_STATE_PENDING ...
2022/02/23 08:53:01 Job still running ...
2022/02/23 08:53:31 Job still running ...
2022/02/23 08:54:01 Job still running ...
2022/02/23 08:54:31 Job still running ...
2022/02/23 08:55:01 Job still running ...
2022/02/23 08:55:31 Job still running ...
2022/02/23 08:56:01 Failed to execute job: job 2022-02-23_00_52_31-3260921882254758861 failed
panic: Failed to execute job: job 2022-02-23_00_52_31-3260921882254758861 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x1046764, 0x19, 0xc0001f9e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 40s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/zp5gnm4rgln7u

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #428

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/428/display/redirect>

Changes:


------------------------------------------
[...truncated 20.81 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645520106356287936/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/22 08:55:07 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645520106356287936/model
2022/02/22 08:55:07 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0222070835"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645520106356287936/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645520106356287936/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0222070835",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/22 08:55:07 Submitted job: 2022-02-22_00_55_07-10715847826038204979
2022/02/22 08:55:07 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-22_00_55_07-10715847826038204979?project=apache-beam-testing
2022/02/22 08:55:07 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-22_00_55_07-10715847826038204979
2022/02/22 08:55:07 Job state: JOB_STATE_PENDING ...
2022/02/22 08:55:37 Job still running ...
2022/02/22 08:56:07 Job still running ...
2022/02/22 08:56:37 Job still running ...
2022/02/22 08:57:07 Job still running ...
2022/02/22 08:57:37 Job still running ...
2022/02/22 08:58:07 Job still running ...
2022/02/22 08:58:37 Failed to execute job: job 2022-02-22_00_55_07-10715847826038204979 failed
panic: Failed to execute job: job 2022-02-22_00_55_07-10715847826038204979 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc00012e000, 0x1046764, 0x19, 0xc00022de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 45s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/avkiq7jdomtxc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #427

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/427/display/redirect>

Changes:


------------------------------------------
[...truncated 20.90 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645467458103804103/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/21 18:17:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645467458103804103/model
2022/02/21 18:17:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0219185417"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645467458103804103/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645467458103804103/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0219185417",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/21 18:17:39 Submitted job: 2022-02-21_10_17_39-1378371553529413098
2022/02/21 18:17:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-21_10_17_39-1378371553529413098?project=apache-beam-testing
2022/02/21 18:17:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-21_10_17_39-1378371553529413098
2022/02/21 18:17:39 Job state: JOB_STATE_PENDING ...
2022/02/21 18:18:09 Job still running ...
2022/02/21 18:18:39 Job still running ...
2022/02/21 18:19:09 Job still running ...
2022/02/21 18:19:40 Job still running ...
2022/02/21 18:20:10 Job still running ...
2022/02/21 18:20:40 Job still running ...
2022/02/21 18:21:10 Job still running ...
2022/02/21 18:21:40 Job still running ...
2022/02/21 18:22:10 Job still running ...
2022/02/21 18:22:40 Job still running ...
2022/02/21 18:23:10 Failed to execute job: job 2022-02-21_10_17_39-1378371553529413098 failed
panic: Failed to execute job: job 2022-02-21_10_17_39-1378371553529413098 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc00012e000, 0x1046764, 0x19, 0xc0003e5e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 56s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/hktdfyqyl6hx4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #426

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/426/display/redirect?page=changes>

Changes:

[rogelio.hernandez] [BEAM-13051] Pylint misplaced-bare-raise warning enabled

[rogelio.hernandez] [BEAM-13051] Added descriptions to Kinesis and PortableRunner exceptions

[thiagotnunes] fix: fix bug when retrieving either string or json

[noreply] [adhoc] Avoid using SerializablePipelineOptions for testing to minimize

[noreply] [BEAM-13812] Integrate DataprocClusterManager into Interactive

[noreply] [BEAM-12572] Fix failing python examples tests in Dataflow runner

[noreply] Remove build status from PR (#16902)


------------------------------------------
[...truncated 20.89 KB...]
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645260757805324681/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/19 08:52:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645260757805324681/model
2022/02/19 08:52:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0219065329"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645260757805324681/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645260757805324681/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0219065329",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/19 08:52:38 Submitted job: 2022-02-19_00_52_38-14704736467524090392
2022/02/19 08:52:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-19_00_52_38-14704736467524090392?project=apache-beam-testing
2022/02/19 08:52:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-19_00_52_38-14704736467524090392
2022/02/19 08:52:39 Job state: JOB_STATE_PENDING ...
2022/02/19 08:53:09 Job still running ...
2022/02/19 08:53:39 Job still running ...
2022/02/19 08:54:09 Job still running ...
2022/02/19 08:54:39 Job still running ...
2022/02/19 08:55:09 Job still running ...
2022/02/19 08:55:39 Job still running ...
2022/02/19 08:56:09 Job still running ...
2022/02/19 08:56:39 Job still running ...
2022/02/19 08:57:09 Job still running ...
2022/02/19 08:57:39 Job still running ...
2022/02/19 08:58:09 Job still running ...
2022/02/19 08:58:39 Failed to execute job: job 2022-02-19_00_52_38-14704736467524090392 failed
panic: Failed to execute job: job 2022-02-19_00_52_38-14704736467524090392 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x1046764, 0x19, 0xc0003fde00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/43atmuiuyzzjq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #425

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/425/display/redirect?page=changes>

Changes:

[Pablo Estrada] Simplify README for new users

[Kenneth Knowles] Disable AfterSynchronizedProcessingTime test on Dataflow

[mmack] [BEAM-13563] Introducing common AWS ClientBuilderFactory to unify

[laraschmidt] Fix final allowskew error to properly handle a large allowedSkew

[noreply] Case studies page improvements (#16702)

[noreply] [BEAM-13946] Add get_dummies(), a non-deferred column operation on

[noreply] [release-2.36.0] Fix pickler argument for 2.36 blog (#16774)


------------------------------------------
[...truncated 20.86 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645174514364145849/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/18 08:55:15 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645174514364145849/model
2022/02/18 08:55:15 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0218065827"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645174514364145849/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645174514364145849/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0218065827",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/18 08:55:15 Submitted job: 2022-02-18_00_55_15-14775230631980518609
2022/02/18 08:55:15 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-18_00_55_15-14775230631980518609?project=apache-beam-testing
2022/02/18 08:55:15 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-18_00_55_15-14775230631980518609
2022/02/18 08:55:16 Job state: JOB_STATE_PENDING ...
2022/02/18 08:55:46 Job still running ...
2022/02/18 08:56:16 Job still running ...
2022/02/18 08:56:46 Job still running ...
2022/02/18 08:57:16 Job still running ...
2022/02/18 08:57:46 Job still running ...
2022/02/18 08:58:16 Job still running ...
2022/02/18 08:58:46 Failed to execute job: job 2022-02-18_00_55_15-14775230631980518609 failed
panic: Failed to execute job: job 2022-02-18_00_55_15-14775230631980518609 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x1046764, 0x19, 0xc000305e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 12s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/i2r7ai5n7edpu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #424

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/424/display/redirect?page=changes>

Changes:

[Jeff Tapper] Update Java LTS roadmap info on website for Java 17

[Kyle Weaver] [BEAM-13106] Support Flink 1.14.

[Kyle Weaver] [BEAM-13106] Reuse executor instead of shutting it down mid-test.

[Kyle Weaver] [BEAM-13106] Prevent infinite wait in Flink savepoint test.

[Ismaël Mejía] [BEAM-13202] Fix typos on tests names for VarianceFnTest

[Ismaël Mejía] [BEAM-13202] Add Coder to CountIfFn.Accum

[Ismaël Mejía] [BEAM-13202] Reuse Count transform code since CountIf is a specific case

[Kenneth Knowles] Add test category UsesProcessingTimeTimers

[Kenneth Knowles] Label tests that need UsesProcessingTimeTimers

[Kenneth Knowles] Exclude UsesProcessingTimeTimers from SamzaRunner tests

[Kyle Weaver] [BEAM-13106] A couple additional fixes to FlinkSavepointTest.

[mmack] [adhoc] Migrate KinesisIOIT to use ITEnvironment for Localstack based IT

[noreply] [BEAM-13955] Fix pylint breakage from #16836 (#16867)

[relax] Fix TableRow conversion for the case of fields named "f"

[noreply] Bump dataflow.fnapi_container_version (#16874)


------------------------------------------
[...truncated 20.89 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645087960526614321/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/17 08:52:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645087960526614321/model
2022/02/17 08:52:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0217065340"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645087960526614321/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645087960526614321/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0217065340",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/17 08:52:43 Submitted job: 2022-02-17_00_52_41-17855254412709097777
2022/02/17 08:52:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-17_00_52_41-17855254412709097777?project=apache-beam-testing
2022/02/17 08:52:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-17_00_52_41-17855254412709097777
2022/02/17 08:52:43 Job state: JOB_STATE_PENDING ...
2022/02/17 08:53:13 Job still running ...
2022/02/17 08:53:43 Job still running ...
2022/02/17 08:54:13 Job still running ...
2022/02/17 08:54:43 Job still running ...
2022/02/17 08:55:13 Job still running ...
2022/02/17 08:55:43 Job still running ...
2022/02/17 08:56:13 Failed to execute job: job 2022-02-17_00_52_41-17855254412709097777 failed
panic: Failed to execute job: job 2022-02-17_00_52_41-17855254412709097777 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x1046764, 0x19, 0xc0005cfe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/djiqgoyl3n3ie

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #423

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/423/display/redirect?page=changes>

Changes:

[stranniknm] [BEAM-13785] playground - enable scio sdk

[mattcasters] [BEAM-13854] Document casting trick for Avro value serializer in KafkaIO

[noreply] Merge pull request #16838 from [BEAM-13931] - make sure large rows cause

[noreply] Seznam Case Study (#16825)

[noreply] [Website] Apache Hop Case Study (#16824)

[noreply] [BEAM-13694] Force hadoop-hdfs-client in hadoopVersion tests for hdfs

[noreply] [Website] Ricardo - added case study feedback (#16807)

[noreply] Merge pull request #16735 from [BEAM-13827] - fix medium file size

[noreply] Merge pull request #16753 from [BEAM-13837] [Playground] show graph on


------------------------------------------
[...truncated 20.90 KB...]
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645001558107814966/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/16 08:52:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645001558107814966/model
2022/02/16 08:52:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0216065329"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645001558107814966/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645001558107814966/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0216065329",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/16 08:52:39 Submitted job: 2022-02-16_00_52_38-2022200920936894707
2022/02/16 08:52:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-16_00_52_38-2022200920936894707?project=apache-beam-testing
2022/02/16 08:52:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-16_00_52_38-2022200920936894707
2022/02/16 08:52:39 Job state: JOB_STATE_PENDING ...
2022/02/16 08:53:09 Job still running ...
2022/02/16 08:53:39 Job still running ...
2022/02/16 08:54:09 Job still running ...
2022/02/16 08:54:39 Job still running ...
2022/02/16 08:55:09 Job still running ...
2022/02/16 08:55:39 Job still running ...
2022/02/16 08:56:09 Job still running ...
2022/02/16 08:56:39 Job still running ...
2022/02/16 08:57:09 Job still running ...
2022/02/16 08:57:39 Job still running ...
2022/02/16 08:58:09 Job still running ...
2022/02/16 08:58:39 Failed to execute job: job 2022-02-16_00_52_38-2022200920936894707 failed
panic: Failed to execute job: job 2022-02-16_00_52_38-2022200920936894707 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc00012e000, 0x1046764, 0x19, 0xc00037de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4bdq2sor7n77c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #422

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/422/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-12712] Spark: Exclude looping timer tests.

[Kyle Weaver] [BEAM-13919] Annotate PerKeyOrderingTest with UsesStatefulParDo.

[noreply] Update 2.36.0 blog post to mention ARM64 support

[noreply] Minor: Disable checker framework in nightly snapshot (#16829)

[artur.khanin] Updated example link

[noreply] [BEAM-13860] Make `DoFn.infer_output_type` return element type (#16788)

[noreply] [BEAM-13894] Unit test utilities in the ptest package (#16830)

[Kenneth Knowles] Add test for processing time continuation trigger

[noreply] [BEAM-13922] [Coverage] Make boot.go more testable and add tests

[noreply] Exclude SpannerChangeStream IT from Dataflow V1 postcommit (#16851)

[noreply] [BEAM-13930] Address StateSpec consistency issue between Runner and Fn


------------------------------------------
[...truncated 20.85 KB...]
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644915157755565963/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/15 08:52:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644915157755565963/model
2022/02/15 08:52:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0215065326"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644915157755565963/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644915157755565963/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0215065326",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/15 08:52:38 Submitted job: 2022-02-15_00_52_38-3897904656225116528
2022/02/15 08:52:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-15_00_52_38-3897904656225116528?project=apache-beam-testing
2022/02/15 08:52:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-15_00_52_38-3897904656225116528
2022/02/15 08:52:38 Job state: JOB_STATE_PENDING ...
2022/02/15 08:53:08 Job still running ...
2022/02/15 08:53:38 Job still running ...
2022/02/15 08:54:08 Job still running ...
2022/02/15 08:54:39 Job still running ...
2022/02/15 08:55:09 Job still running ...
2022/02/15 08:55:39 Failed to execute job: job 2022-02-15_00_52_38-3897904656225116528 failed
panic: Failed to execute job: job 2022-02-15_00_52_38-3897904656225116528 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc00012e000, 0x1046764, 0x19, 0xc0001f5e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bjthu2vxphpzq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #421

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/421/display/redirect?page=changes>

Changes:

[akustov] fix name project id from secreton scio deploy action

[alexander.zhuravlev] [BEAM-13775] Fixed bug with run button

[ihr] [BEAM-13836] Fix the answers placeholders locations in the Python katas

[noreply] Merge pull request #16703 from [BEAM-13804][Playground][Bugfix] Add

[noreply] Merge pull request #16611 from [BEAM-13712][Playground] Add graph for

[noreply] Merge pull request #16757 from [BEAM-13655] [Playground] Persist the


------------------------------------------
[...truncated 20.92 KB...]
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644828763617148925/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/14 08:52:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644828763617148925/model
2022/02/14 08:52:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0214065330"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644828763617148925/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644828763617148925/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0214065330",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/14 08:52:45 Submitted job: 2022-02-14_00_52_44-17790309931399248750
2022/02/14 08:52:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-14_00_52_44-17790309931399248750?project=apache-beam-testing
2022/02/14 08:52:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-14_00_52_44-17790309931399248750
2022/02/14 08:52:45 Job state: JOB_STATE_PENDING ...
2022/02/14 08:53:15 Job still running ...
2022/02/14 08:53:45 Job still running ...
2022/02/14 08:54:15 Job still running ...
2022/02/14 08:54:45 Job still running ...
2022/02/14 08:55:15 Job still running ...
2022/02/14 08:55:45 Job still running ...
2022/02/14 08:56:15 Job still running ...
2022/02/14 08:56:45 Job still running ...
2022/02/14 08:57:15 Job still running ...
2022/02/14 08:57:45 Job still running ...
2022/02/14 08:58:15 Job still running ...
2022/02/14 08:58:45 Failed to execute job: job 2022-02-14_00_52_44-17790309931399248750 failed
panic: Failed to execute job: job 2022-02-14_00_52_44-17790309931399248750 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x1046764, 0x19, 0xc000357e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fbsorquiwxx7a

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #420

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/420/display/redirect?page=changes>

Changes:

[randomstep] [BEAM-9195] Bump org.testcontainers to 1.16.3


------------------------------------------
[...truncated 20.85 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644742358083315282/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/13 08:52:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644742358083315282/model
2022/02/13 08:52:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0213065329"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644742358083315282/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644742358083315282/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0213065329",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/13 08:52:39 Submitted job: 2022-02-13_00_52_38-3574788092158563632
2022/02/13 08:52:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-13_00_52_38-3574788092158563632?project=apache-beam-testing
2022/02/13 08:52:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-13_00_52_38-3574788092158563632
2022/02/13 08:52:39 Job state: JOB_STATE_PENDING ...
2022/02/13 08:53:09 Job still running ...
2022/02/13 08:53:39 Job still running ...
2022/02/13 08:54:09 Job still running ...
2022/02/13 08:54:39 Job still running ...
2022/02/13 08:55:09 Job still running ...
2022/02/13 08:55:39 Job still running ...
2022/02/13 08:56:09 Failed to execute job: job 2022-02-13_00_52_38-3574788092158563632 failed
panic: Failed to execute job: job 2022-02-13_00_52_38-3574788092158563632 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x1046764, 0x19, 0xc0004d7e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/3palgrcusw62m

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #419

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/419/display/redirect?page=changes>

Changes:

[Carl Yeksigian] Cache bucket matcher regex in GcsPath

[noreply] [BEAM-4032]Support staging binary distributions of dependency packages

[noreply] [BEAM-13834] Increase influxDB persistent storage. (#16817)

[noreply] Minor: Fix link to nexmark benchmarks (#16803)

[noreply] Regenerate python container base_image_requirements.txt (#16832)


------------------------------------------
[...truncated 20.78 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644655948300191537/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/12 08:52:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644655948300191537/model
2022/02/12 08:52:29 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0212065324"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644655948300191537/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644655948300191537/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0212065324",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/12 08:52:30 Submitted job: 2022-02-12_00_52_29-8918007186338239601
2022/02/12 08:52:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-12_00_52_29-8918007186338239601?project=apache-beam-testing
2022/02/12 08:52:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-12_00_52_29-8918007186338239601
2022/02/12 08:52:30 Job state: JOB_STATE_PENDING ...
2022/02/12 08:53:00 Job still running ...
2022/02/12 08:53:30 Job still running ...
2022/02/12 08:54:00 Job still running ...
2022/02/12 08:54:30 Job still running ...
2022/02/12 08:55:00 Job still running ...
2022/02/12 08:55:30 Job still running ...
2022/02/12 08:56:00 Failed to execute job: job 2022-02-12_00_52_29-8918007186338239601 failed
panic: Failed to execute job: job 2022-02-12_00_52_29-8918007186338239601 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0001a6000, 0x1046764, 0x19, 0xc000817e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/k2yhm4b62rq74

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #418

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/418/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-12672] Retry flaky tests

[benjamin.gonzalez] [BEAM-12672] Fix spotlessApply

[laraschmidt] Fixing the log line to properly handle a large allowed skew.

[n] BEAM-13159 Update embedded-redis dependency

[n] address comments

[noreply] Minor: Add 2.38.0 section to CHANGES.md (#16804)

[noreply] [BEAM-12000] Fix typo in portable Python job definition (#16812)

[noreply] [BEAM-12164]: Fixes SpannerChangeStreamIT (#16806)

[noreply] [BEAM-12572] Fix failures in python examples tests (#16781)

[noreply] [BEAM-13921] filter out debeziumIO test for spark runner (#16815)

[noreply] [BEAM-13855] Skip SpannerChangeStreamOrderedWithinKeyIT and

[noreply] [BEAM-13679] playground - move quick start category to the top (#16808)

[noreply] Update license_script.sh (#16789)

[noreply] [BEAM-13908] [Coverage] Better testing coverage for gcpopts (#16816)

[noreply] Merge pull request #16809 from [BEAM-12164] Added integration test for


------------------------------------------
[...truncated 20.94 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644569555903719184/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/11 08:52:36 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644569555903719184/model
2022/02/11 08:52:36 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0211065332"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644569555903719184/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644569555903719184/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0211065332",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/11 08:52:38 Submitted job: 2022-02-11_00_52_36-8952945090550606510
2022/02/11 08:52:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-11_00_52_36-8952945090550606510?project=apache-beam-testing
2022/02/11 08:52:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-11_00_52_36-8952945090550606510
2022/02/11 08:52:38 Job state: JOB_STATE_PENDING ...
2022/02/11 08:53:08 Job still running ...
2022/02/11 08:53:38 Job still running ...
2022/02/11 08:54:08 Job still running ...
2022/02/11 08:54:38 Job still running ...
2022/02/11 08:55:08 Job still running ...
2022/02/11 08:55:38 Job still running ...
2022/02/11 08:56:08 Failed to execute job: job 2022-02-11_00_52_36-8952945090550606510 failed
panic: Failed to execute job: job 2022-02-11_00_52_36-8952945090550606510 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc00012e000, 0x1046764, 0x19, 0xc000807e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/exmenxsx47qiq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #417

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/417/display/redirect?page=changes>

Changes:

[david.prieto.rivera] Missing contribution

[mmack] [adhoc] Remove remaining usage of Powermock from aws2.

[noreply] [BEAM-13803] Add support for native iterable side inputs to the Go SDK

[noreply] [BEAM-11095] Better error handling for illegal emit functions (#16776)

[noreply] Merge pull request #16613 from Supporting JdbcIO driver in classpath for

[noreply] Merge pull request #15848 from [BEAM-13835] An any-type implementation

[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define simple generators.

[Valentyn Tymofieiev] Add a container for Python 3.9.

[Valentyn Tymofieiev] Allow job submission with Python 3.9 on Dataflow runner

[Valentyn Tymofieiev] Add Python 3.9 test suites. Keep Dataflow V1 suites unchanged for now.

[Valentyn Tymofieiev] Add py3.9 Github actions suites.

[Valentyn Tymofieiev] Py39 Doc updates.

[Valentyn Tymofieiev] [BEAM-9980] Simplify run_validates_container.sh to avoid branching.

[Valentyn Tymofieiev] Update Cython to a new version that has py39 wheels.

[Valentyn Tymofieiev] [BEAM-13845] Fix comparison with potentially incomparable default

[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define simple generators.

[Valentyn Tymofieiev] Mark Python 3.9 as supported version.

[noreply] [release-2.36.0][website] Fix github release notes script, header for

[noreply] Use shell to run python for setupVirtualenv (#16796)

[Daniel Oliveira] [BEAM-13830] Properly shut down Debezium expansion service in IT script.

[noreply] Merge pull request #16659 from [BEAM-13774][Playground] Add user to

[Valentyn Tymofieiev] [BEAM-13868] Remove gsutil dep from hdfs IT test.

[noreply] [BEAM-13776][Playground] (#16731)

[noreply] [BEAM-13867] Drop NaNs returned by nlargest in flight_delays example

[noreply] Announce Python 3.9 in CHANGES.md (#16802)

[Brian Hulette] Moving to 2.38.0-SNAPSHOT on master branch.

[noreply] [BEAM-11095] Better error handling for iter/reiter/multimap (#16794)


------------------------------------------
[...truncated 20.90 KB...]
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644483160371965554/****\022@b26d35e2dc5da3a2977d34fe239c920ec8d99212483f03422f7f14e552d7a2ab"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/10 08:52:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644483160371965554/model
2022/02/10 08:52:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0210065340"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644483160371965554/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644483160371965554/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0210065340",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/10 08:52:42 Submitted job: 2022-02-10_00_52_41-830863468111324543
2022/02/10 08:52:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-10_00_52_41-830863468111324543?project=apache-beam-testing
2022/02/10 08:52:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-10_00_52_41-830863468111324543
2022/02/10 08:52:42 Job state: JOB_STATE_PENDING ...
2022/02/10 08:53:12 Job still running ...
2022/02/10 08:53:42 Job still running ...
2022/02/10 08:54:12 Job still running ...
2022/02/10 08:54:42 Job still running ...
2022/02/10 08:55:12 Job still running ...
2022/02/10 08:55:42 Job still running ...
2022/02/10 08:56:12 Job still running ...
2022/02/10 08:56:42 Job still running ...
2022/02/10 08:57:12 Job still running ...
2022/02/10 08:57:42 Job still running ...
2022/02/10 08:58:12 Job still running ...
2022/02/10 08:58:42 Failed to execute job: job 2022-02-10_00_52_41-830863468111324543 failed
panic: Failed to execute job: job 2022-02-10_00_52_41-830863468111324543 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x115a2e8, 0xc0000480c0, 0x1046764, 0x19, 0xc00040be00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/z7kyhdkofdtbm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #416

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/416/display/redirect?page=changes>

Changes:

[noreply] Update README.md

[marco.robles] Update README with latest PreCommit Jobs

[marco.robles] Update Postcommit jobs with latest jobs

[marco.robles] Update Performace job tests in readme

[marco.robles] update load job tests with latest updates

[marco.robles] update other jobs test with latest updates

[marco.robles] mismatch links fix

[marco.robles] update trigger phrase for some postCommit jobs

[marco.robles] correct trigger phrases in readme

[marco.robles] add pending jobs to readme

[noreply] Update README.md

[mmack] [BEAM-13246] Add support for S3 Bucket Key at the object level (AWS Sdk

[Ismaël Mejía] [BEAM-13839] Upgrade zstd-jni to version 1.5.2-1

[mmack] [BEAM-13840] Fix usage of legacy rawtypes in AWS modules

[Pablo Estrada] Output successful rows from BQ Streaming Inserts

[schapman] BEAM-13439 Type annotation for ptransform_fn

[noreply] [BEAM-13606] Fail bundles with failed BigTable mutations (#16751)

[marco.robles] fix broken links in jobs & remove the invalid ones

[Kyle Weaver] Update Dataflow Python dev container images.

[Kiley Sok] Add java 17 to changes

[noreply] [BEAM-12914] Add missing 3.9 opcodes to type inference. (#16761)

[noreply] [BEAM-13321] Initial BigQueryIO externalization. (#16489)

[noreply] [BEAM-13193] Enable process bundle response elements embedding in Java

[noreply] [BEAM-13830] added a debeziumio_expansion_addr flag to GoSDK (#16780)

[noreply] Apply spotless. (#16783)

[Daniel Oliveira] [BEAM-13732] Switch x-lang BigQueryIO expansion service to GCP one.

[noreply] [BEAM-13858] Fix broken github action on :sdks:go:examples:wordCount

[Kiley Sok] add jira for runner v2

[noreply] [BEAM-13732] Go SDK BigQuery IO wrapper. Initial implementation.

[noreply] [BEAM-13732] Add example for Go BigQuery IO wrapper. (#16786)

[noreply] Update CHANGES.md with Go SDK milestones. (#16787)

[noreply] [BEAM-13193] Allow BeamFnDataOutboundObserver to flush elements.


------------------------------------------
[...truncated 20.89 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644396760184572928/****\022@24707ee0721a614604dbc0f233835fe10eb8a8434c1ab7687750db689e8de303"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/09 08:52:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644396760184572928/model
2022/02/09 08:52:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0209065330"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644396760184572928/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644396760184572928/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0209065330",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/09 08:52:41 Submitted job: 2022-02-09_00_52_40-1351170888603113870
2022/02/09 08:52:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-09_00_52_40-1351170888603113870?project=apache-beam-testing
2022/02/09 08:52:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-09_00_52_40-1351170888603113870
2022/02/09 08:52:41 Job state: JOB_STATE_PENDING ...
2022/02/09 08:53:11 Job still running ...
2022/02/09 08:53:41 Job still running ...
2022/02/09 08:54:11 Job still running ...
2022/02/09 08:54:41 Job still running ...
2022/02/09 08:55:11 Job still running ...
2022/02/09 08:55:41 Job still running ...
2022/02/09 08:56:11 Failed to execute job: job 2022-02-09_00_52_40-1351170888603113870 failed
panic: Failed to execute job: job 2022-02-09_00_52_40-1351170888603113870 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1158c48, 0xc00012e000, 0x10453bd, 0x19, 0xc000807e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/tp2b4ihnjqb2s

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #415

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/415/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-12976] Log projection pushdown optimizations.

[benjamin.gonzalez] [BEAM-12572] Change jobs to run as cron jobs

[alexander.zhuravlev] [BEAM-13820] Changed color of delete icon in pipeline options dropdown,

[noreply] [BEAM-11971] Revert "Fix timer consistency in direct runner" (#16748)

[noreply] [BEAM-13193] Aggregates fn api outbound data/timers of different

[noreply] [BEAM-13767] Migrate a bundle of grade tasks to use configuration

[noreply] Merge pull request #16653 from [BEAM-12164]: Add integration tests for

[noreply] Merge pull request #16728 from [BEAM-13823] Update docs for SnowflakeIO

[noreply] Merge pull request #16660 from [BEAM-13771][Playground] Send multifile

[noreply] Merge pull request #16646 from [BEAM-13643][Playground] Setup running

[noreply] [BEAM-13015] Add state caching benchmark and move benchmarks to their

[noreply] [BEAM-13419] Check for initialization in dataflow runner (#16765)

[noreply] Merge pull request #16701 from [BEAM-13786] [Playground] [Bugfix] Update

[noreply] Merge pull request #16754 from [BEAM-13838][Playground] Add logs in case

[noreply] [BEAM-13293] consistent naming for expansion service address and flag

[noreply] Merge pull request #16700 from [BEAM-13790][Playground] Change logic of

[noreply] [BEAM-13830] update dependency for debeziumio expansion service (#16743)

[noreply] [BEAM-13761] consistent namings for expansion address in Debezium IO

[noreply] [BEAM-13806] Shutting down SchemaIO expansion services from Go VR

[noreply] [release-2.36.0] Update website/changelog for release 2.36.0 (#16627)

[noreply] [BEAM-13848] Update numpy intersphinx link (#16767)

[noreply] [release-23.6.0] Fix JIRA link for 2.36 blog (#16771)

[noreply] [BEAM-13647] Use role for Go worker binary. (#16729)


------------------------------------------
[...truncated 20.85 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644310360417129307/****\022@24707ee0721a614604dbc0f233835fe10eb8a8434c1ab7687750db689e8de303"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/08 08:52:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644310360417129307/model
2022/02/08 08:52:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0208065327"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644310360417129307/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644310360417129307/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0208065327",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/08 08:52:41 Submitted job: 2022-02-08_00_52_41-13303701709949550803
2022/02/08 08:52:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-08_00_52_41-13303701709949550803?project=apache-beam-testing
2022/02/08 08:52:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-08_00_52_41-13303701709949550803
2022/02/08 08:52:41 Job state: JOB_STATE_PENDING ...
2022/02/08 08:53:11 Job still running ...
2022/02/08 08:53:41 Job still running ...
2022/02/08 08:54:11 Job still running ...
2022/02/08 08:54:42 Job still running ...
2022/02/08 08:55:12 Job still running ...
2022/02/08 08:55:42 Job still running ...
2022/02/08 08:56:12 Failed to execute job: job 2022-02-08_00_52_41-13303701709949550803 failed
panic: Failed to execute job: job 2022-02-08_00_52_41-13303701709949550803 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1158c48, 0xc0000480c0, 0x10453bd, 0x19, 0xc0007a7e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mpqzeeraqh3aq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #414

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/414/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #16726 from [BEAM-12164]: Parses change streams

[mmack] [BEAM-13147] Avoid nullness issue during init of AwsModule (AWS Sdk v2)


------------------------------------------
[...truncated 21.44 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/07 15:43:06 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644248586204781898/model
2022/02/07 15:43:06 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0207154154"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644248586204781898/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644248586204781898/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0207154154",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/07 15:43:09 Submitted job: 2022-02-07_07_43_06-15068199158436748486
2022/02/07 15:43:09 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-07_07_43_06-15068199158436748486?project=apache-beam-testing
2022/02/07 15:43:09 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-07_07_43_06-15068199158436748486
2022/02/07 15:43:09 Job state: JOB_STATE_PENDING ...
2022/02/07 15:43:39 Job still running ...
2022/02/07 15:44:09 Job still running ...
2022/02/07 15:44:39 Job still running ...
2022/02/07 15:45:09 Job still running ...
2022/02/07 15:45:39 Job still running ...
2022/02/07 15:46:09 Job still running ...
2022/02/07 15:46:39 Failed to execute job: job 2022-02-07_07_43_06-15068199158436748486 failed
panic: Failed to execute job: job 2022-02-07_07_43_06-15068199158436748486 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1157828, 0xc0000480c0, 0x104429d, 0x19, 0xc0006e9e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gxhlgqpgnthjk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #413

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/413/display/redirect?page=changes>

Changes:

[mmack] [BEAM-13663] Remove unused duplicate option for AWS client configuration

[mmack] [BEAM-13203] Deprecate SnsIO.writeAsync for AWS Sdk v2 due to risk of

[noreply] [BEAM-13828] Fix stale bot (#16734)

[noreply] Merge pull request #16364 from [BEAM-13182]  Add diagrams to backend

[noreply] [BEAM-13811] Fix save_main_session arg in tests examples (#16709)

[Kiley Sok] Update beam-master version

[noreply] [BEAM-13015] Calculate exception for closing BeamFnDataInboundObserver2

[noreply] Minor doc tweaks for validating vendoring. (#16747)

[noreply] [BEAM-13686] OOM while logging a large pipeline even when logging level

[noreply] [BEAM-13629] Update URL artifact type for Dataflow Go (#16490)

[noreply] [BEAM-13832] Add automated expansion service start-up to JDBCio (#16739)

[noreply] [BEAM-13831] Add automated expansion service infra into Debezium Read()

[noreply] [BEAM-13821] Add automated expansion service start-up to KafkaIO

[noreply] [BEAM-13799] Created a Dataproc cluster manager for Interactive Beam

[noreply] Merge pull request #16727: [BEAM-11971] remove unsafe Concurrent data


------------------------------------------
[...truncated 21.32 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/05 08:52:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644051150984304866/model
2022/02/05 08:52:31 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0205065333"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644051150984304866/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644051150984304866/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0205065333",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/05 08:52:32 Submitted job: 2022-02-05_00_52_31-10423129262484430790
2022/02/05 08:52:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-05_00_52_31-10423129262484430790?project=apache-beam-testing
2022/02/05 08:52:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-05_00_52_31-10423129262484430790
2022/02/05 08:52:32 Job state: JOB_STATE_PENDING ...
2022/02/05 08:53:02 Job still running ...
2022/02/05 08:53:32 Job still running ...
2022/02/05 08:54:02 Job still running ...
2022/02/05 08:54:32 Job still running ...
2022/02/05 08:55:02 Job still running ...
2022/02/05 08:55:32 Job still running ...
2022/02/05 08:56:02 Failed to execute job: job 2022-02-05_00_52_31-10423129262484430790 failed
panic: Failed to execute job: job 2022-02-05_00_52_31-10423129262484430790 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1157828, 0xc00012e000, 0x104429d, 0x19, 0xc0004d7e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 40s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/b2hrkmj4boej2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #412

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/412/display/redirect?page=changes>

Changes:

[Kiley Sok] Allow Java 17 to be used in SDK

[Kiley Sok] add testing support

[Kiley Sok] Add more testing support for java 17

[Kiley Sok] workaround for jamm

[Kiley Sok] Add Jenkins test for Java 17

[Kiley Sok] Fix jvm hex and skip errorprone

[Kiley Sok] Fix display data for anonymous classes

[Kiley Sok] fix jpms tests

[Kiley Sok] skip zetasql

[Kiley Sok] spotless

[Kiley Sok] spotless

[Kiley Sok] Fix trigger

[Kiley Sok] skip checker framework

[Kiley Sok] fix app name

[Kiley Sok] remove duplicate property check

[Heejong Lee] [BEAM-13813] Add support for URL artifact to extractStagingToPath

[avilovpavel6] Remove Python SQL Test example from catalog

[relax] Fix timer consistency in direct runner

[noreply] [BEAM-13757] adds pane observation in DoFn (#16629)

[Jan Lukavský] Change links to Books from Amazon to Publisher

[noreply] [BEAM-13605] Add support for pandas 1.4.0 (#16590)

[noreply] [BEAM-13761] adds Debezium IO wrapper for Go SDK (#16642)

[noreply] [BEAM-13024] Unify PipelineOptions behavior (#16719)

[noreply] Update sdks/go/pkg/beam/artifact/materialize_test.go

[noreply] Merge pull request #16605 from [BEAM-13634][Playground] Create a

[noreply] Merge pull request #16593 from [BEAM-13725][Playground] Add graph to the

[noreply] Merge pull request #16699 from [BEAM-13789][Playground] Change logic of

[alexander.chermenin] Fixed CSS for Case study page


------------------------------------------
[...truncated 21.36 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/04 08:52:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643964761748982279/model
2022/02/04 08:52:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0204065331"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643964761748982279/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643964761748982279/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0204065331",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/04 08:52:43 Submitted job: 2022-02-04_00_52_42-4333728848427349032
2022/02/04 08:52:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-04_00_52_42-4333728848427349032?project=apache-beam-testing
2022/02/04 08:52:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-04_00_52_42-4333728848427349032
2022/02/04 08:52:43 Job state: JOB_STATE_PENDING ...
2022/02/04 08:53:13 Job still running ...
2022/02/04 08:53:43 Job still running ...
2022/02/04 08:54:13 Job still running ...
2022/02/04 08:54:43 Job still running ...
2022/02/04 08:55:13 Job still running ...
2022/02/04 08:55:43 Job still running ...
2022/02/04 08:56:13 Failed to execute job: job 2022-02-04_00_52_42-4333728848427349032 failed
panic: Failed to execute job: job 2022-02-04_00_52_42-4333728848427349032 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1156768, 0xc00012e000, 0x104329d, 0x19, 0xc00052fe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/m2rbo2ak4e7cm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #411

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/411/display/redirect?page=changes>

Changes:

[aydar.zaynutdinov] [BEAM-13737][Playground]

[Robert Bradshaw] Make num-stages counter into an internal counter.

[Kenneth Knowles] [BEAM-13768] Fix NullPointerException in BigQueryStorageSourceBase

[Robert Bradshaw] Avoid packaging avro in the java harness jar.

[mmack] [BEAM-13563] Restructure Kinesis Source for Aws 2 internally to prepare

[noreply] [BEAM-4665] Allow joining a running dataflow pipeline without throwing

[noreply] [BEAM-13801] Add standard coder tests for state backed iterable.

[noreply] [BEAM-13430]  Fix provided configuration by removing extendsFrom for

[noreply] [BEAM-12830] Print clearer go version fail message (#16693)

[Jan Lukavský] Add reference to Books to Learning Resources in website

[noreply] Use ThreadLocal for DESERIALIZATION_CONTEXT (#16680)

[noreply] Minor: Add apt update after adding deadsnakes repository in dev env

[noreply] [BEAM-13807] Regenerate container images to get TF 2.8.0 (#16707)

[noreply] [BEAM-13399, BEAM-13683] Eagerly materialize artifacts for automated

[noreply] Merge pull request #16617 from [BEAM-13743] [Playground] Add context

[noreply] Merge pull request #16618 from [BEAM-13744] [Playground] Add context

[noreply] Merge pull request #16698 from [BEAM-13802][Playground] [Bugfix] Clean

[noreply] [BEAM-13293][BEAM-13806] Pipe a SchemaIO flag through Go integration

[noreply] [BEAM-13605] Modify groupby.apply implementation in preparation for

[noreply] Merge pull request #16436 from [BEAM-1330] - DatastoreIO Writes should


------------------------------------------
[...truncated 21.47 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/03 16:32:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643905948414282139/model
2022/02/03 16:32:29 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0203153031"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643905948414282139/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643905948414282139/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0203153031",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/03 16:32:29 Submitted job: 2022-02-03_08_32_29-11512827635332800334
2022/02/03 16:32:29 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-03_08_32_29-11512827635332800334?project=apache-beam-testing
2022/02/03 16:32:29 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-03_08_32_29-11512827635332800334
2022/02/03 16:32:29 Job state: JOB_STATE_PENDING ...
2022/02/03 16:32:59 Job still running ...
2022/02/03 16:33:29 Job still running ...
2022/02/03 16:33:59 Job still running ...
2022/02/03 16:34:29 Job still running ...
2022/02/03 16:34:59 Job still running ...
2022/02/03 16:35:29 Job still running ...
2022/02/03 16:35:59 Job still running ...
2022/02/03 16:36:29 Job still running ...
2022/02/03 16:37:00 Job still running ...
2022/02/03 16:37:30 Job still running ...
2022/02/03 16:38:00 Failed to execute job: job 2022-02-03_08_32_29-11512827635332800334 failed
panic: Failed to execute job: job 2022-02-03_08_32_29-11512827635332800334 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1155548, 0xc00012e000, 0x1042239, 0x19, 0xc0003c5e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 4s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/z3tavlgwsncm4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #410

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/410/display/redirect?page=changes>

Changes:

[career] [BEAM-13734] Support cache directories that use GCS buckets

[noreply] Merge pull request #16655 from [BEAM-12164]: Add retry protection to

[noreply] Merge pull request #16586 from [BEAM-13731] FhirIO: Add support for

[noreply] [BEAM-13011] Adds a link to Multi-language Pipelines Tips wiki page

[noreply] [BEAM-12572] Run python examples on multiple runners (#16154)

[noreply] [BEAM-13574] Large Wordcount (#16455)

[noreply] [BEAM-13293] Refactor JDBC IO Go Wrapper (#16686)

[noreply] Edit license script for Java, add manual licenses for xz (#16692)


------------------------------------------
[...truncated 21.40 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/02 08:53:19 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643791998954743884/model
2022/02/02 08:53:19 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0202065329"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643791998954743884/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643791998954743884/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0202065329",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/02 08:53:20 Submitted job: 2022-02-02_00_53_19-113769330016341627
2022/02/02 08:53:20 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-02_00_53_19-113769330016341627?project=apache-beam-testing
2022/02/02 08:53:20 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-02_00_53_19-113769330016341627
2022/02/02 08:53:20 Job state: JOB_STATE_PENDING ...
2022/02/02 08:53:50 Job still running ...
2022/02/02 08:54:20 Job still running ...
2022/02/02 08:54:50 Job still running ...
2022/02/02 08:55:20 Job still running ...
2022/02/02 08:55:50 Job still running ...
2022/02/02 08:56:20 Job still running ...
2022/02/02 08:56:50 Job still running ...
2022/02/02 08:57:20 Failed to execute job: job 2022-02-02_00_53_19-113769330016341627 failed
panic: Failed to execute job: job 2022-02-02_00_53_19-113769330016341627 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1152648, 0xc0000480d0, 0x103f6fc, 0x19, 0xc000439e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ze7jirvylktm4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #409

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/409/display/redirect?page=changes>

Changes:

[daria.malkova] Support SCIO SDK via sbt projects

[samuelw] [BEAM-11648] Share thread pool across RetryManager instances.

[Pablo Estrada] Exclude per-key order tests on Twister2 runner

[mrudary] Generalize S3FileSystem to support multiple URI schemes.

[Heejong Lee] Fix Java SDK container image name for load-tests and nexmark

[daria.malkova] Change executable name fo go tests

[avilovpavel6] Fix java test

[noreply] [BEAM-13769] Skip test_main_session_not_staged_when_using_cloudpickle

[noreply] [BEAM-6744] Support implicitly setting project id in Go Dataflow runner

[noreply] Merge pull request #16493 from [BEAM-13632][Playground] Save catalog

[noreply] Exclude jul-to-slf4j from Spark runner in quickstart POM templates

[noreply] [BEAM-11936] Enable a few errorprone checks that were broken by pinned

[noreply] [BEAM-13780] Add CONTRIBUTING.md pointing to main guide (#16666)

[noreply] [BEAM-13777] Accept cache capacity as input parameter instead of default

[noreply] [BEAM-13051][A] Enable pylint warnings

[noreply] [BEAM-13779] Fix pr labeling (#16665)

[noreply] Merge pull request #16581 from [BEAM-12164]: Add

[noreply] Fix labeler trigger (#16674)

[noreply] [BEAM-13781] Exclude grpc-netty-shaded from gax-grpc's dependency

[noreply] [BEAM-13051] Fixed pylint warnings : raising-non-exception (E0710),

[noreply] [BEAM-13740] Correctly install go before running tests (#16673)

[noreply] [BEAM-12830] Update local Docker env Go version. (#16670)

[noreply] [BEAM-13051][B] Enable pylint warnings

[noreply] [BEAM-13430] Revert Spark libraries in Spark runner to provided (#16675)

[noreply] [BEAM-12240] Add Java 17 support (#16568)

[noreply] [BEAM-13760] Add random component to default python dataflow job name


------------------------------------------
[...truncated 21.46 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/01 08:52:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643705558363749036/model
2022/02/01 08:52:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0201073706"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643705558363749036/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643705558363749036/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0201073706",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/01 08:52:39 Submitted job: 2022-02-01_00_52_39-16369070691264608222
2022/02/01 08:52:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-01_00_52_39-16369070691264608222?project=apache-beam-testing
2022/02/01 08:52:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-01_00_52_39-16369070691264608222
2022/02/01 08:52:39 Job state: JOB_STATE_PENDING ...
2022/02/01 08:53:09 Job still running ...
2022/02/01 08:53:39 Job still running ...
2022/02/01 08:54:10 Job still running ...
2022/02/01 08:54:40 Job still running ...
2022/02/01 08:55:10 Job still running ...
2022/02/01 08:55:40 Job still running ...
2022/02/01 08:56:10 Job still running ...
2022/02/01 08:56:40 Job still running ...
2022/02/01 08:57:10 Job still running ...
2022/02/01 08:57:40 Job still running ...
2022/02/01 08:58:10 Failed to execute job: job 2022-02-01_00_52_39-16369070691264608222 failed
panic: Failed to execute job: job 2022-02-01_00_52_39-16369070691264608222 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1152648, 0xc00012e000, 0x103f6fc, 0x19, 0xc000441e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/oclqlrhlw3tuw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #408

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/408/display/redirect>

Changes:


------------------------------------------
[...truncated 21.39 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/31 08:52:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643619157225039601/model
2022/01/31 08:52:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0131070036"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643619157225039601/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643619157225039601/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0131070036",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/31 08:52:38 Submitted job: 2022-01-31_00_52_37-7829632524595342416
2022/01/31 08:52:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-31_00_52_37-7829632524595342416?project=apache-beam-testing
2022/01/31 08:52:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-31_00_52_37-7829632524595342416
2022/01/31 08:52:38 Job state: JOB_STATE_PENDING ...
2022/01/31 08:53:08 Job still running ...
2022/01/31 08:53:38 Job still running ...
2022/01/31 08:54:08 Job still running ...
2022/01/31 08:54:38 Job still running ...
2022/01/31 08:55:08 Job still running ...
2022/01/31 08:55:38 Job still running ...
2022/01/31 08:56:08 Job still running ...
2022/01/31 08:56:38 Job still running ...
2022/01/31 08:57:08 Job still running ...
2022/01/31 08:57:38 Job still running ...
2022/01/31 08:58:09 Failed to execute job: job 2022-01-31_00_52_37-7829632524595342416 failed
panic: Failed to execute job: job 2022-01-31_00_52_37-7829632524595342416 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1152648, 0xc0000480d0, 0x103f6fc, 0x19, 0xc0003efe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/sfv6lng4idrje

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #407

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/407/display/redirect>

Changes:


------------------------------------------
[...truncated 21.29 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/30 08:52:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643532752875068102/model
2022/01/30 08:52:33 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0130071559"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643532752875068102/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643532752875068102/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0130071559",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/30 08:52:34 Submitted job: 2022-01-30_00_52_33-16493615378576641830
2022/01/30 08:52:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-30_00_52_33-16493615378576641830?project=apache-beam-testing
2022/01/30 08:52:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-30_00_52_33-16493615378576641830
2022/01/30 08:52:34 Job state: JOB_STATE_PENDING ...
2022/01/30 08:53:04 Job still running ...
2022/01/30 08:53:34 Job still running ...
2022/01/30 08:54:04 Job still running ...
2022/01/30 08:54:34 Job still running ...
2022/01/30 08:55:04 Job still running ...
2022/01/30 08:55:34 Job still running ...
2022/01/30 08:56:04 Failed to execute job: job 2022-01-30_00_52_33-16493615378576641830 failed
panic: Failed to execute job: job 2022-01-30_00_52_33-16493615378576641830 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1152648, 0xc0000480d0, 0x103f6fc, 0x19, 0xc0003ffe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 43s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/emiaya3ugf3co

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #406

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/406/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-13751] Don't block on gcloud when attempting to get default GCP

[Kyle Weaver] [BEAM-13751] Parameterize wait timeout so test doesn't waste 2s.

[Kyle Weaver] [BEAM-13751] Add comment explaining sleep.

[noreply] Update Python SDK beam-master tags (#16630)

[noreply] Merge pull request #16592 from [BEAM-13722][Playground] Add precompiling

[noreply] Merge pull request #16505 from [BEAM-13527] [Playground] Pipeline

[noreply] [BEAM-13293] XLang Jdbc IO for Go SDK (#16111)

[noreply] [BEAM-10206] Add Go Vet to Github Actions (#16612)


------------------------------------------
[...truncated 21.84 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/29 08:52:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643446363435161514/model
2022/01/29 08:52:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0129072802"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643446363435161514/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643446363435161514/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0129072802",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/29 08:52:44 Submitted job: 2022-01-29_00_52_44-2371356349304898508
2022/01/29 08:52:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-29_00_52_44-2371356349304898508?project=apache-beam-testing
2022/01/29 08:52:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-29_00_52_44-2371356349304898508
2022/01/29 08:52:44 Job state: JOB_STATE_PENDING ...
2022/01/29 08:53:14 Job still running ...
2022/01/29 08:53:44 Job still running ...
2022/01/29 08:54:14 Job still running ...
2022/01/29 08:54:44 Job still running ...
2022/01/29 08:55:14 Job still running ...
2022/01/29 08:55:45 Job still running ...
2022/01/29 08:56:15 Job still running ...
2022/01/29 08:56:45 Job still running ...
2022/01/29 08:57:15 Job still running ...
2022/01/29 08:57:45 Job still running ...
2022/01/29 08:58:15 Failed to execute job: job 2022-01-29_00_52_44-2371356349304898508 failed
panic: Failed to execute job: job 2022-01-29_00_52_44-2371356349304898508 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1152648, 0xc0001a6000, 0x103f6fc, 0x19, 0xc0003c3e00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/zufxfrf6qgfli

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #405

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/405/display/redirect?page=changes>

Changes:

[marcin.kuthan] Get rid of unnessecary logs for BigQuery streaming writes in

[dhuntsperger] added GitHub example references to Python multilang quickstart

[mmack] [adhoc] Test S3Options and AwsOptions for Sdk v2

[noreply] [BEAM-13537] Fix NPE in kafkatopubsub example (#16625)

[noreply] [BEAM-13740] update java_tests.yml to remove setup-go, which is

[Heejong Lee] Fix google3 import error

[noreply] [BEAM-12976] Implement Java projection pushdown optimizer. (#16513)

[noreply] Merge pull request #16579 from Revert "Revert "Merge pull request #15863

[noreply] Merge pull request #16606 from [BEAM-13247] [Playground] Embedding


------------------------------------------
[...truncated 21.37 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/28 08:52:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643359961942340980/model
2022/01/28 08:52:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0128074355"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643359961942340980/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643359961942340980/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0128074355",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/28 08:52:43 Submitted job: 2022-01-28_00_52_42-7579071257179065806
2022/01/28 08:52:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-28_00_52_42-7579071257179065806?project=apache-beam-testing
2022/01/28 08:52:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-28_00_52_42-7579071257179065806
2022/01/28 08:52:43 Job state: JOB_STATE_PENDING ...
2022/01/28 08:53:13 Job still running ...
2022/01/28 08:53:43 Job still running ...
2022/01/28 08:54:13 Job still running ...
2022/01/28 08:54:43 Job still running ...
2022/01/28 08:55:13 Job still running ...
2022/01/28 08:55:43 Job still running ...
2022/01/28 08:56:13 Failed to execute job: job 2022-01-28_00_52_42-7579071257179065806 failed
panic: Failed to execute job: job 2022-01-28_00_52_42-7579071257179065806 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151048, 0xc0000480c0, 0x103e423, 0x19, 0xc0004ede00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dmxr3tvk7wh6g

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #404

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/404/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-13093] Enable JavaUsingPython CrossLanguageValidateRunner test for

[mmack] [BEAM-8807] Add integration test for SnsIO.write (Sdk v1 & v2)

[mmack] [BEAM-13746] Fix deserialization of SSECustomerKey for AWS Sdk v2

[noreply] [BEAM-7928] Allow users to specify worker disk type for Dataflow runner

[noreply] Merge pull request #16534 from [BEAM-13671][Playground] Add backend

[noreply] [BEAM-13271] Bump errorprone to 2.10.0 (#16231)

[noreply] [BEAM-13595] Don't load main session when cloudpickle is used. (#16589)

[Heejong Lee] Update readme for XVR tests


------------------------------------------
[...truncated 21.37 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/27 08:52:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643273570448457667/model
2022/01/27 08:52:51 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0127065515"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643273570448457667/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643273570448457667/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0127065515",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/27 08:52:51 Submitted job: 2022-01-27_00_52_51-15137149499719543758
2022/01/27 08:52:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-27_00_52_51-15137149499719543758?project=apache-beam-testing
2022/01/27 08:52:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-27_00_52_51-15137149499719543758
2022/01/27 08:52:51 Job state: JOB_STATE_PENDING ...
2022/01/27 08:53:21 Job still running ...
2022/01/27 08:53:51 Job still running ...
2022/01/27 08:54:21 Job still running ...
2022/01/27 08:54:51 Job still running ...
2022/01/27 08:55:21 Job still running ...
2022/01/27 08:55:52 Job still running ...
2022/01/27 08:56:22 Failed to execute job: job 2022-01-27_00_52_51-15137149499719543758 failed
panic: Failed to execute job: job 2022-01-27_00_52_51-15137149499719543758 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151048, 0xc00012e000, 0x103e423, 0x19, 0xc00054de00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 58s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/oygu22s5jmnvq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_Combine_Dataflow_Batch #403

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/403/display/redirect?page=changes>

Changes:

[artur.khanin] Privacy policy update regarding Apache Beam Playground

[Daniel Oliveira] [BEAM-13321] Fix exception with BigQuery StreamWriter TraceID.

[mmack] [BEAM-13510] Don't retry on invalid SQS receipt handles.

[noreply] [BEAM-13736] Make lifting cache exact. (#16603)

[noreply] Merge pull request #16565 from [BEAM-13692][Playground]  Implement

[noreply] Merge pull request #16502 from [BEAM-13650][Playground] Add link for

[noreply] [BEAM-13310] remove call to get offset consumer config, which was rep…


------------------------------------------
[...truncated 21.41 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "s2"
root_transform_ids: "e7"
root_transform_ids: "e8"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/26 08:52:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643187163292781712/model
2022/01/26 08:52:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-combine-1-0126065331"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "top_count",
          "namespace": "go_options",
          "type": "STRING",
          "value": "20"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/combine"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "fanout",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_combine_1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643187163292781712/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "fanout": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_combine_1",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 200000000,\"key_size\": 1,\"value_size\": 9}",
          "top_count": "20",
          "****_binary": "linux_amd64/combine"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 5,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643187163292781712/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-combine-1-0126065331",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/26 08:52:44 Submitted job: 2022-01-26_00_52_43-456839806931881255
2022/01/26 08:52:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-26_00_52_43-456839806931881255?project=apache-beam-testing
2022/01/26 08:52:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-26_00_52_43-456839806931881255
2022/01/26 08:52:44 Job state: JOB_STATE_PENDING ...
2022/01/26 08:53:14 Job still running ...
2022/01/26 08:53:44 Job still running ...
2022/01/26 08:54:14 Job still running ...
2022/01/26 08:54:44 Job still running ...
2022/01/26 08:55:14 Job still running ...
2022/01/26 08:55:44 Job still running ...
2022/01/26 08:56:14 Failed to execute job: job 2022-01-26_00_52_43-456839806931881255 failed
panic: Failed to execute job: job 2022-01-26_00_52_43-456839806931881255 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1150fe8, 0xc0000480b0, 0x103e3fa, 0x19, 0xc00081fe00, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/combine/combine.go>:80 +0x414

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_Combine_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/44mcessbsdzsm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org