You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/01/08 11:18:24 UTC

Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #384

See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/384/display/redirect?page=changes>

Changes:

[Alexey Romanenko] [adhoc] Fix BigTableIO description

[noreply] [BEAM-13015] Remove dead code now that all instances have migrated to

[noreply] [BEAM-13386] Add RLock support for cloudpickle (#16250)

[danthev] Fix overflow


------------------------------------------
[...truncated 18.46 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/08 11:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641640490712485259/model
2022/01/08 11:14:51 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0108100344"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641640490712485259/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641640490712485259/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0108100344",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/08 11:14:52 Submitted job: 2022-01-08_03_14_51-3156273502209194503
2022/01/08 11:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-08_03_14_51-3156273502209194503?project=apache-beam-testing
2022/01/08 11:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-08_03_14_51-3156273502209194503
2022/01/08 11:14:52 Job state: JOB_STATE_PENDING ...
2022/01/08 11:15:22 Job still running ...
2022/01/08 11:15:52 Job still running ...
2022/01/08 11:16:22 Job still running ...
2022/01/08 11:16:52 Job still running ...
2022/01/08 11:17:22 Job still running ...
2022/01/08 11:17:52 Job still running ...
2022/01/08 11:18:22 Failed to execute job: job 2022-01-08_03_14_51-3156273502209194503 failed
panic: Failed to execute job: job 2022-01-08_03_14_51-3156273502209194503 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143348, 0xc000120000, 0x1032053, 0x19, 0xc0003ebdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ct75zky3fom2w

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_LoadTests_Go_SideInput_Dataflow_Batch #501

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/501/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #500

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/500/display/redirect?page=changes>

Changes:

[zyichi] Move master readme.md to 2.40.0

[noreply] [BEAM-14173] Fix Go Loadtests on Dataflow & partial fix for Flink


------------------------------------------
[...truncated 17.53 KB...]
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c5"
      component_coder_ids: "c6"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651770393262002459/****\022@965e0bb55b25907cfa423dd63625577fd640a0171a3b81f50cb1e4c273f470ec"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 17:06:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651770393262002459/model
2022/05/05 17:06:33 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0505150443"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.40.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770393262002459/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.40.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651770393262002459/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.40.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0505150443",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/05 17:06:34 Submitted job: 2022-05-05_10_06_34-8125495731363788730
2022/05/05 17:06:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_10_06_34-8125495731363788730?project=apache-beam-testing
2022/05/05 17:06:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_10_06_34-8125495731363788730
2022/05/05 17:06:34 Job state: JOB_STATE_PENDING ...
2022/05/05 17:07:04 Job still running ...
2022/05/05 17:07:34 Job still running ...
2022/05/05 17:08:04 Job still running ...
2022/05/05 17:08:34 Job still running ...
2022/05/05 17:09:04 Job still running ...
2022/05/05 17:09:35 Failed to execute job: job 2022-05-05_10_06_34-8125495731363788730 failed
panic: Failed to execute job: job 2022-05-05_10_06_34-8125495731363788730 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231ce8, 0xc0000480c0, 0x110ea7a, 0x19, 0xc00041de68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:92 +0x471

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 25s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lbffyaomyvaiu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #499

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/499/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-9245] Unable to pull datatore Entity which contains dict

[bulat.safiullin] [BEAM-14382] [Website] add banner container for with css, images, html

[Jan Lukavský] [BEAM-14196] add test verifying output watermark propagation in bundle

[Jan Lukavský] [BEAM-14196] Fix FlinkRunner mid-bundle output watermark handling

[nielm] [BEAM-14405] Fix NPE when ProjectID is not specified in a template

[bulat.safiullin] [BEAM-14382] change mobile banner img, add padding to banner section

[ahmedabualsaud] fix test decotrator typo

[noreply] Merge pull request #17440 from [BEAM-14329] Enable exponential backoff

[noreply] [BEAM-11104] Fix output forwarding issue for ProcessContinuations

[noreply] re-add testing package to pydoc (#17524)

[Heejong Lee] add test

[noreply] [BEAM-14250] Amended the workaround (#17531)

[noreply] [BEAM-11104] Fix broken split result validation (#17546)

[noreply] Fixed a SQL and screenshots in the Beam SQL blog (#17545)

[noreply] Merge pull request #17417: [BEAM-14388] Address some performance

[noreply] [BEAM-14386] [Flink] Support for scala 2.12 (#17512)

[noreply] [BEAM-14294] Worker changes to support trivial Batched DoFns (#17384)

[zyichi] Moving to 2.40.0-SNAPSHOT on master branch.

[noreply] [BEAM-14048] [CdapIO] Add ConfigWrapper for building CDAP PluginConfigs


------------------------------------------
[...truncated 17.35 KB...]
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c5"
      component_coder_ids: "c6"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.40.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651749303377555240/****\022@8b5200c424addfeb22f0ea76b779b4694bfd6e95d0c22a38b3992e1016522c8b"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/05 11:15:04 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651749303377555240/model
2022/05/05 11:15:04 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0505100411"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.40.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651749303377555240/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.40.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651749303377555240/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.40.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.40.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0505100411",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/05 11:15:04 Submitted job: 2022-05-05_04_15_04-18243073991136963016
2022/05/05 11:15:04 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-05_04_15_04-18243073991136963016?project=apache-beam-testing
2022/05/05 11:15:04 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-05_04_15_04-18243073991136963016
2022/05/05 11:15:04 Job state: JOB_STATE_PENDING ...
2022/05/05 11:15:34 Job still running ...
2022/05/05 11:16:04 Job still running ...
2022/05/05 11:16:34 Job still running ...
2022/05/05 11:17:04 Job still running ...
2022/05/05 11:17:34 Job still running ...
2022/05/05 11:18:05 Failed to execute job: job 2022-05-05_04_15_04-18243073991136963016 failed
panic: Failed to execute job: job 2022-05-05_04_15_04-18243073991136963016 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231c88, 0xc0000480c0, 0x110ea1a, 0x19, 0xc0006ebe68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ccognekwjayac

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #498

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/498/display/redirect?page=changes>

Changes:

[noreply] fix: JDBC config schema fields order

[Brian Hulette] Revert "Merge pull request #17255 from kileys/test-revert"

[Brian Hulette] BEAM-14231: bypass schema cache for

[noreply] [BEAM-13657] Follow up update version warning in __init__ (#17493)

[noreply] Merge pull request #17431 from [BEAM-14273] Add integration tests for BQ

[noreply] Merge pull request #17205 from [BEAM-14145] [Website] add carousel to

[noreply] [BEAM-14064] fix es io windowing (#17112)

[noreply] [BEAM-13670] Upgraded ipython from v7 to v8 (#17529)

[noreply] [BEAM-11104] Enable ProcessContinuation return values, add unit test

[Robert Bradshaw] [BEAM-14403] Allow Prime to be used with legacy workers.

[noreply] [BEAM-11106] Support drain in Go SDK (#17432)

[noreply] add __Init__ to inference. (#17514)


------------------------------------------
[...truncated 17.29 KB...]
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c5"
      component_coder_ids: "c6"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651662883556773094/****\022@730b6467ef232e5fc6b39140457e9af03e8b89e09fa666f0f0713858f3fc70f1"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/04 11:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651662883556773094/model
2022/05/04 11:14:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651662883556773094/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651662883556773094/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/04 11:14:44 Submitted job: 2022-05-04_04_14_44-11675152796227470620
2022/05/04 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-04_04_14_44-11675152796227470620?project=apache-beam-testing
2022/05/04 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-04_04_14_44-11675152796227470620
2022/05/04 11:14:45 Job state: JOB_STATE_PENDING ...
2022/05/04 11:15:15 Job still running ...
2022/05/04 11:15:45 Job still running ...
2022/05/04 11:16:15 Job still running ...
2022/05/04 11:16:45 Job still running ...
2022/05/04 11:17:15 Job still running ...
2022/05/04 11:17:45 Failed to execute job: job 2022-05-04_04_14_44-11675152796227470620 failed
panic: Failed to execute job: job 2022-05-04_04_14_44-11675152796227470620 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1231c88, 0xc000120000, 0x110ea1a, 0x19, 0xc000363e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4nrs363myodjy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #497

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/497/display/redirect?page=changes>

Changes:

[yathu] [BEAM-14375] Fix Java Wordcount Dataflow postcommit

[Robert Bradshaw] Allow arithmetic between deferred scalars.

[noreply] [BEAM-14390] Set user-agent when pulling licenses to avoid 403s (#17521)

[noreply] [BEAM-8688] Upgrade GCSIO to 2.2.6 (#17486)

[noreply] [BEAM-14253] patch SubscriptionPartitionLoader to work around a dataflow

[noreply] Add website link log to notify user of pre-build workflow. (#17498)

[noreply] [BEAM-11105] Add timestamp observing watermark estimation (#17476)

[noreply] Merge pull request #17487 from Adding user-agent to GCS client in Python

[noreply] [BEAM-10265] Display error message if trying to infer recursive schema

[noreply] [BEAM-12575] Upgraded ipykernel from v5 to v6 (#17526)

[noreply] [BEAM-11105] Add docs + CHANGES.md entry for Go Watermark Estimation

[noreply] Merge pull request #17380 from [BEAM-14314][BEAM-9532] Add last_updated


------------------------------------------
[...truncated 17.36 KB...]
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c5"
      component_coder_ids: "c6"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651576480197248312/****\022@9469aad017f592f98ec13d096c1a887a2a2c819cc6c728ec9a526347e22798b3"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/03 11:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651576480197248312/model
2022/05/03 11:14:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651576480197248312/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651576480197248312/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/03 11:14:41 Submitted job: 2022-05-03_04_14_40-17107207761468874636
2022/05/03 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-03_04_14_40-17107207761468874636?project=apache-beam-testing
2022/05/03 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-03_04_14_40-17107207761468874636
2022/05/03 11:14:41 Job state: JOB_STATE_PENDING ...
2022/05/03 11:15:11 Job still running ...
2022/05/03 11:15:42 Job still running ...
2022/05/03 11:16:12 Job still running ...
2022/05/03 11:16:42 Job still running ...
2022/05/03 11:17:12 Job still running ...
2022/05/03 11:17:42 Failed to execute job: job 2022-05-03_04_14_40-17107207761468874636 failed
panic: Failed to execute job: job 2022-05-03_04_14_40-17107207761468874636 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x122e1e8, 0xc0000480c0, 0x110b4e7, 0x19, 0xc0005fde68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mgsseehpks2tk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #496

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/496/display/redirect?page=changes>

Changes:

[noreply] [BEAM-11105] Add manual watermark estimation (#17475)


------------------------------------------
[...truncated 17.38 KB...]
      component_coder_ids: "c5"
      component_coder_ids: "c6"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651490080383081791/****\022@530c8060dd70daedac2ab5b8c66f220f07189c67be45725ffb046aaf2ee21133"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/02 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651490080383081791/model
2022/05/02 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651490080383081791/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651490080383081791/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/02 11:14:41 Submitted job: 2022-05-02_04_14_41-7991502072018766536
2022/05/02 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-02_04_14_41-7991502072018766536?project=apache-beam-testing
2022/05/02 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-02_04_14_41-7991502072018766536
2022/05/02 11:14:41 Job state: JOB_STATE_PENDING ...
2022/05/02 11:15:11 Job still running ...
2022/05/02 11:15:41 Job still running ...
2022/05/02 11:16:12 Job still running ...
2022/05/02 11:16:42 Job still running ...
2022/05/02 11:17:12 Job still running ...
2022/05/02 11:17:42 Job still running ...
2022/05/02 11:18:12 Job still running ...
2022/05/02 11:18:42 Job still running ...
2022/05/02 11:19:12 Job still running ...
2022/05/02 11:19:42 Failed to execute job: job 2022-05-02_04_14_41-7991502072018766536 failed
panic: Failed to execute job: job 2022-05-02_04_14_41-7991502072018766536 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x120aa48, 0xc000120000, 0x10e8184, 0x19, 0xc00041fe68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/63edeh25jqbje

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #495

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/495/display/redirect?page=changes>

Changes:

[noreply] Revert "Improvement to Seed job configuration to launch against PRs

[ilion.beyst] Minor: fix typo

[noreply] Merge pull request #17422 from [BEAM-14344]: remove tracing from


------------------------------------------
[...truncated 17.45 KB...]
      component_coder_ids: "c5"
      component_coder_ids: "c6"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651403676958150470/****\022@c7ae89a0f6002bb078c0953452e2bc5d7e6531247bddaba76672134a19f57b1d"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/05/01 11:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651403676958150470/model
2022/05/01 11:14:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651403676958150470/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651403676958150470/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/05/01 11:14:38 Submitted job: 2022-05-01_04_14_37-1203156572924052887
2022/05/01 11:14:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-05-01_04_14_37-1203156572924052887?project=apache-beam-testing
2022/05/01 11:14:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-05-01_04_14_37-1203156572924052887
2022/05/01 11:14:38 Job state: JOB_STATE_PENDING ...
2022/05/01 11:15:08 Job still running ...
2022/05/01 11:15:38 Job still running ...
2022/05/01 11:16:08 Job still running ...
2022/05/01 11:16:38 Job still running ...
2022/05/01 11:17:08 Job still running ...
2022/05/01 11:17:38 Job still running ...
2022/05/01 11:18:08 Job still running ...
2022/05/01 11:18:38 Job still running ...
2022/05/01 11:19:08 Job still running ...
2022/05/01 11:19:38 Failed to execute job: job 2022-05-01_04_14_37-1203156572924052887 failed
panic: Failed to execute job: job 2022-05-01_04_14_37-1203156572924052887 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209748, 0xc0000480c0, 0x10e70b2, 0x19, 0xc000855e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wk2lldlqwpk46

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #494

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/494/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Add element weighting parameter to BatchElements.

[Robert Bradshaw] Clearer test.

[noreply] Revert "Merge pull request #17260 from [BEAM-13229] [Website] bug side

[noreply] [BEAM-14001] Add missing test cases to existing suites in exec package

[noreply] [BEAM-14243] Add staticcheck to Github Actions Precommits (#17479)

[noreply] [BEAM-14368][BEAM-13984]Change model loading from constructor to

[noreply] [BEAM-13983] changed file name from sklearn_loader to sklearn_inference

[noreply] Add SQL in Notebooks blog post (#17481)

[noreply] Merge pull request #17404: [BEAM-13990] support date and timestamp


------------------------------------------
[...truncated 17.32 KB...]
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c5"
      component_coder_ids: "c6"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651317278123143372/****\022@c7ae89a0f6002bb078c0953452e2bc5d7e6531247bddaba76672134a19f57b1d"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/30 11:14:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651317278123143372/model
2022/04/30 11:14:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651317278123143372/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651317278123143372/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/30 11:14:39 Submitted job: 2022-04-30_04_14_38-15271518655655570463
2022/04/30 11:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-30_04_14_38-15271518655655570463?project=apache-beam-testing
2022/04/30 11:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-30_04_14_38-15271518655655570463
2022/04/30 11:14:39 Job state: JOB_STATE_PENDING ...
2022/04/30 11:15:09 Job still running ...
2022/04/30 11:15:39 Job still running ...
2022/04/30 11:16:10 Job still running ...
2022/04/30 11:16:40 Job still running ...
2022/04/30 11:17:10 Job still running ...
2022/04/30 11:17:40 Failed to execute job: job 2022-04-30_04_14_38-15271518655655570463 failed
panic: Failed to execute job: job 2022-04-30_04_14_38-15271518655655570463 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209748, 0xc0000480c0, 0x10e70b2, 0x19, 0xc0008b5e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 16s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/i5bqjvkstn4tk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #493

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/493/display/redirect?page=changes>

Changes:

[ihr] Update Java katas to Beam 2.38

[noreply] [BEAM-14369] Fix "target/options: no such file or directory" error while

[noreply] [BEAM-14297] Enable nullable key and value arrays for xlang kafka io

[noreply] Merge pull request #17444 from [BEAM-14310] [Website] bug home

[noreply] Merge pull request #17388 from [BEAM-14311] [Website] Home Page

[noreply] [BEAM-14376] Typo in method description doc

[noreply] Add default classpath when not present (#17491)

[thiagotnunes] fix: update javadocs for ChangeStreamMetrics

[noreply] Merge pull request #17443 from [BEAM-12164]: use the end timestamp for

[noreply] Merge pull request #17260 from [BEAM-13229] [Website] bug side nav

[noreply] [BEAM-14351] Fix the template and move the announcement to the next


------------------------------------------
[...truncated 17.37 KB...]
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c5"
      component_coder_ids: "c6"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651230880732906721/****\022@c7ae89a0f6002bb078c0953452e2bc5d7e6531247bddaba76672134a19f57b1d"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/29 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651230880732906721/model
2022/04/29 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651230880732906721/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651230880732906721/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/29 11:14:41 Submitted job: 2022-04-29_04_14_41-3702943351343415152
2022/04/29 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-29_04_14_41-3702943351343415152?project=apache-beam-testing
2022/04/29 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-29_04_14_41-3702943351343415152
2022/04/29 11:14:41 Job state: JOB_STATE_PENDING ...
2022/04/29 11:15:11 Job still running ...
2022/04/29 11:15:41 Job still running ...
2022/04/29 11:16:12 Job still running ...
2022/04/29 11:16:42 Job still running ...
2022/04/29 11:17:12 Job still running ...
2022/04/29 11:17:42 Failed to execute job: job 2022-04-29_04_14_41-3702943351343415152 failed
panic: Failed to execute job: job 2022-04-29_04_14_41-3702943351343415152 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209748, 0xc000120000, 0x10e70b2, 0x19, 0xc0004f9e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gak2wnfljfaqg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #492

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/492/display/redirect?page=changes>

Changes:

[nick.caballero] [BEAM-14363] Fixes WatermarkParameters builder for Kinesis

[noreply] [BEAM-11104] Add Checkpointing split to Go SDK (#17386)

[noreply] Merge pull request #17226 from [BEAM-14204] [Playground] Tests for

[noreply] [BEAM-13015, BEAM-14184] Address unbounded number of messages being

[noreply] Improvement to Seed job configuration to launch against PRs (#17468)

[noreply] [BEAM-13983] Small changes to sklearn runinference (#17459)

[chamikaramj] Renames ExternalPythonTransform to PythonExternalTransform

[noreply] [BEAM-14351] Inherit from Coder. (#17437)


------------------------------------------
[...truncated 17.24 KB...]
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c5"
      component_coder_ids: "c6"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651144473683239804/****\022@c7ae89a0f6002bb078c0953452e2bc5d7e6531247bddaba76672134a19f57b1d"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/28 11:14:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651144473683239804/model
2022/04/28 11:14:34 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0428111043"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651144473683239804/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651144473683239804/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0428111043",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/28 11:14:34 Submitted job: 2022-04-28_04_14_34-995233978919696732
2022/04/28 11:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-28_04_14_34-995233978919696732?project=apache-beam-testing
2022/04/28 11:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-28_04_14_34-995233978919696732
2022/04/28 11:14:35 Job state: JOB_STATE_PENDING ...
2022/04/28 11:15:05 Job still running ...
2022/04/28 11:15:35 Job still running ...
2022/04/28 11:16:05 Job still running ...
2022/04/28 11:16:35 Job still running ...
2022/04/28 11:17:05 Job still running ...
2022/04/28 11:17:35 Failed to execute job: job 2022-04-28_04_14_34-995233978919696732 failed
panic: Failed to execute job: job 2022-04-28_04_14_34-995233978919696732 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1209748, 0xc000120000, 0x10e70b2, 0x19, 0xc00040de68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 11s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/frox5fjqcjcp2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #491

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/491/display/redirect?page=changes>

Changes:

[msbukal] FhirIO: use .search() or .searchType instead of .setResourceType()

[noreply] Remove unnecessary decorator from RunInference interface (#17463)

[noreply] [BEAM-13590] Minor deprecated warning fix (#17453)

[noreply] [BEAM-12164]: fix the negative throughput issue (#17461)

[noreply] Updated goldens for the screen diff integration tests (#17467)

[noreply] fixes copy by value error for bytes.Buffer in Error (#17469)

[noreply] Merge pull request #17354 from [BEAM-14170] - Create a test that runs

[noreply] Merge pull request #17447 from [BEAM-14357] Fix

[noreply] [BEAM-14324, BEAM-14325] Staticcheck cleanup in test files (#17393)

[noreply] BEAM-14187 Fix NPE (#17454)

[noreply] [BEAM-11105] Stateful watermark estimation (#17374)

[noreply] [BEAM-14304] implement parquetio to read/write parquet files (#17347)


------------------------------------------
[...truncated 17.26 KB...]
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c5"
      component_coder_ids: "c6"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1651058073364325344/****\022@d267add035eb52bfd1973070a9580ba3cdef5344c135e22040a83fcbf1168014"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/27 11:14:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1651058073364325344/model
2022/04/27 11:14:34 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0427100419"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651058073364325344/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1651058073364325344/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0427100419",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/27 11:14:34 Submitted job: 2022-04-27_04_14_34-17081245784420134682
2022/04/27 11:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-27_04_14_34-17081245784420134682?project=apache-beam-testing
2022/04/27 11:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-27_04_14_34-17081245784420134682
2022/04/27 11:14:34 Job state: JOB_STATE_PENDING ...
2022/04/27 11:15:04 Job still running ...
2022/04/27 11:15:34 Job still running ...
2022/04/27 11:16:04 Job still running ...
2022/04/27 11:16:34 Job still running ...
2022/04/27 11:17:04 Job still running ...
2022/04/27 11:17:35 Failed to execute job: job 2022-04-27_04_14_34-17081245784420134682 failed
panic: Failed to execute job: job 2022-04-27_04_14_34-17081245784420134682 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1208328, 0xc0000480c0, 0x10e5f92, 0x19, 0xc000549e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 10s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/aj5rhbbexe5a6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #490

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/490/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14343] Allow expansion service override in ExternalPythonTransform

[Heejong Lee] update

[Heejong Lee] allows remote host

[Heejong Lee] improve compatibility with python rowcoder

[ahmedabualsaud] added tempLocation to test pipeline options

[ahmedabualsaud] using tempRoot for temp bucket location

[ahmedabualsaud] small fixes

[noreply] [BEAM-14320] Update programming-guide w/Java GroupByKey example (#17369)

[noreply] Minor: Fix release script for `current` symlinks (#17457)

[noreply] Minor: fix typo (#17452)

[noreply] Change return type for PytorchInferenceRunner (#17460)

[noreply] [BEAM-13608] JmsIO dynamic topics feature (#17163)

[Heejong Lee] add test


------------------------------------------
[...truncated 16.98 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650971665459731516/****\022@2fe3fcd517b9019d3d4bfd67e9102bd0ecbae3f942f5518a641bd1472d159aa7"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/26 11:14:26 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650971665459731516/model
2022/04/26 11:14:26 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0426100415"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650971665459731516/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650971665459731516/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0426100415",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/26 11:14:27 Submitted job: 2022-04-26_04_14_26-16032744212517726053
2022/04/26 11:14:27 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-26_04_14_26-16032744212517726053?project=apache-beam-testing
2022/04/26 11:14:27 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-26_04_14_26-16032744212517726053
2022/04/26 11:14:27 Job state: JOB_STATE_PENDING ...
2022/04/26 11:14:57 Job still running ...
2022/04/26 11:15:27 Job still running ...
2022/04/26 11:15:57 Job still running ...
2022/04/26 11:16:27 Job still running ...
2022/04/26 11:16:57 Job still running ...
2022/04/26 11:17:28 Failed to execute job: job 2022-04-26_04_14_26-16032744212517726053 failed
panic: Failed to execute job: job 2022-04-26_04_14_26-16032744212517726053 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030e8, 0xc000120000, 0x10e1a7b, 0x19, 0xc0005e1e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 7s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/apct74pduckxq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #489

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/489/display/redirect>

Changes:


------------------------------------------
[...truncated 17.06 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650885280713259917/****\022@2fe3fcd517b9019d3d4bfd67e9102bd0ecbae3f942f5518a641bd1472d159aa7"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/25 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650885280713259917/model
2022/04/25 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0425100358"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650885280713259917/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650885280713259917/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0425100358",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/25 11:14:42 Submitted job: 2022-04-25_04_14_41-3135459039358807346
2022/04/25 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-25_04_14_41-3135459039358807346?project=apache-beam-testing
2022/04/25 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-25_04_14_41-3135459039358807346
2022/04/25 11:14:42 Job state: JOB_STATE_PENDING ...
2022/04/25 11:15:12 Job still running ...
2022/04/25 11:15:42 Job still running ...
2022/04/25 11:16:12 Job still running ...
2022/04/25 11:16:42 Job still running ...
2022/04/25 11:17:12 Job still running ...
2022/04/25 11:17:42 Failed to execute job: job 2022-04-25_04_14_41-3135459039358807346 failed
panic: Failed to execute job: job 2022-04-25_04_14_41-3135459039358807346 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030e8, 0xc000120000, 0x10e1a7b, 0x19, 0xc00076fe68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 17s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lkvweevsm6uwy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #488

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/488/display/redirect?page=changes>

Changes:

[noreply] [BEAM-13953] added documentation for BQ Storage Write API (#17391)


------------------------------------------
[...truncated 17.11 KB...]
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650798879929467693/****\022@2fe3fcd517b9019d3d4bfd67e9102bd0ecbae3f942f5518a641bd1472d159aa7"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/24 11:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650798879929467693/model
2022/04/24 11:14:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0424100359"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650798879929467693/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650798879929467693/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0424100359",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/24 11:14:41 Submitted job: 2022-04-24_04_14_40-2901583024172633209
2022/04/24 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-24_04_14_40-2901583024172633209?project=apache-beam-testing
2022/04/24 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-24_04_14_40-2901583024172633209
2022/04/24 11:14:41 Job state: JOB_STATE_PENDING ...
2022/04/24 11:15:11 Job still running ...
2022/04/24 11:15:41 Job still running ...
2022/04/24 11:16:11 Job still running ...
2022/04/24 11:16:41 Job still running ...
2022/04/24 11:17:11 Job still running ...
2022/04/24 11:17:41 Job still running ...
2022/04/24 11:18:11 Job still running ...
2022/04/24 11:18:41 Job still running ...
2022/04/24 11:19:11 Job still running ...
2022/04/24 11:19:42 Failed to execute job: job 2022-04-24_04_14_40-2901583024172633209 failed
panic: Failed to execute job: job 2022-04-24_04_14_40-2901583024172633209 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030e8, 0xc000120000, 0x10e1a7b, 0x19, 0xc00041fe68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/slh4aek4nhwbk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #487

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/487/display/redirect?page=changes>

Changes:

[Andrew Pilloud] [BEAM-14321] SQL passes Null for Null aggregates

[noreply] Create apache-hop-with-dataflow.md

[noreply] Add files via upload

[noreply] Delete website/www/site/content/en/blog/apache-hop-with-dataflow

[noreply] Add files via upload

[Andrew Pilloud] [BEAM-14348] Upgrade to ZetaSQL 2022.04.1

[Andrew Pilloud] [BEAM-13735] Enable ZetaSQL tests for Java 17

[noreply] Update apache-hop-with-dataflow.md

[noreply] Update apache-hop-with-dataflow.md

[noreply] Update apache-hop-with-dataflow.md

[danielamartinmtz] Moved up get-credentials instruction for getting the kubeconfig file

[noreply] [BEAM-13657] Add python 3.6 update to CHANGES.md (#17435)

[noreply] Merge pull request #17438: [BEAM-8127] The GCP module to declare

[noreply] Merge pull request #17428: [BEAM-14326] Make sure BigQuery daemon thread

[noreply] [BEAM-14301] Add lint:ignore to noescape() func (#17355)

[noreply] [BEAM-14286] Remove unused vars in harness package (#17392)

[noreply] [BEAM-14327] Convert Results to QueryResults directly (#17398)

[noreply] [BEAM-14302] Simplify boolean check in fn.go (#17399)

[noreply] [BEAM-13983] Sklearn Loader for RunInference (#17368)

[noreply] Update authors.yml

[noreply] [BEAM-14358] add retry to connect to testcontainer (#17449)

[noreply] [BEAM-13106] Bump flink docs to 1.14 (#17430)


------------------------------------------
[...truncated 17.09 KB...]
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650712478629777475/****\022@2fe3fcd517b9019d3d4bfd67e9102bd0ecbae3f942f5518a641bd1472d159aa7"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/23 11:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650712478629777475/model
2022/04/23 11:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0423100413"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650712478629777475/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650712478629777475/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0423100413",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/23 11:14:40 Submitted job: 2022-04-23_04_14_39-4076309692626444915
2022/04/23 11:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-23_04_14_39-4076309692626444915?project=apache-beam-testing
2022/04/23 11:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-23_04_14_39-4076309692626444915
2022/04/23 11:14:40 Job state: JOB_STATE_PENDING ...
2022/04/23 11:15:10 Job still running ...
2022/04/23 11:15:40 Job still running ...
2022/04/23 11:16:10 Job still running ...
2022/04/23 11:16:40 Job still running ...
2022/04/23 11:17:10 Job still running ...
2022/04/23 11:17:40 Job still running ...
2022/04/23 11:18:10 Job still running ...
2022/04/23 11:18:41 Job still running ...
2022/04/23 11:19:11 Job still running ...
2022/04/23 11:19:41 Failed to execute job: job 2022-04-23_04_14_39-4076309692626444915 failed
panic: Failed to execute job: job 2022-04-23_04_14_39-4076309692626444915 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030e8, 0xc0000480c0, 0x10e1a7b, 0x19, 0xc000759e68, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/j3wlzdu2vq5ja

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #486

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/486/display/redirect?page=changes>

Changes:

[mmack] [BEAM-14335] Spotless Spark sources

[mmack] [BEAM-14345] Force paranamer 2.8 for Spark Hadoop version tests to avoid

[noreply] BEAM-13582 Fixing broken links in the documentation (#17300)

[kamil.bregula] Revert "[BEAM-14300] Fix Java precommit failure"

[kamil.bregula] Revert "Merge pull request #17223 from [BEAM-14215] Improve argument

[noreply] [BEAM-13657] Sunset python 3.6 (#17252)

[noreply] Removes unsupported Python 3.6 from the release validation script

[noreply] [BEAM-13984] Implement RunInference for PyTorch (#17196)

[noreply] [BEAM-13945] add json type support for java bigquery connector (#17209)

[noreply] [BEAM-14346] Fix incorrect error case index in ret2() (#17425)

[noreply] [BEAM-14342] Fix wrong default buffer type in fn_runner (#17420)

[noreply] Updates opencensus-api dependency to the latest version - 0.31.0

[noreply] [BEAM-14306] Add unit testing to pane coder (#17370)

[noreply] Updated the dep and golden for screen diff integration tests (#17442)


------------------------------------------
[...truncated 17.06 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650626083765026754/****\022@481771bde4db2f4b1d409c2eb3ce2d9d6848529da24e3af1efc7390617339824"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/22 11:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650626083765026754/model
2022/04/22 11:14:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0422100420"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650626083765026754/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650626083765026754/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0422100420",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/22 11:14:45 Submitted job: 2022-04-22_04_14_44-3328384947147369364
2022/04/22 11:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-22_04_14_44-3328384947147369364?project=apache-beam-testing
2022/04/22 11:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-22_04_14_44-3328384947147369364
2022/04/22 11:14:45 Job state: JOB_STATE_PENDING ...
2022/04/22 11:15:15 Job still running ...
2022/04/22 11:15:45 Job still running ...
2022/04/22 11:16:15 Job still running ...
2022/04/22 11:16:45 Job still running ...
2022/04/22 11:17:15 Job still running ...
2022/04/22 11:17:45 Failed to execute job: job 2022-04-22_04_14_44-3328384947147369364 failed
panic: Failed to execute job: job 2022-04-22_04_14_44-3328384947147369364 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1203108, 0xc000120000, 0x10e1a7b, 0x19, 0xc0007c7df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/shdsrvx4zd2pc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #485

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/485/display/redirect?page=changes>

Changes:

[vachan] Annotating Read API tests.

[bulat.safiullin] [BEAM-14247] [Website] add image

[bulat.safiullin] [BEAM-14247] [Website] center image

[mattcasters] BEAM-1857 : CHANGES.md entry for 2.38.0

[mmack] [BEAM-14323] Improve IDE integration of Spark cross version builds

[noreply] [BEAM-14112] Fixed ReadFromBigQuery with Interactive Beam (#17306)

[noreply] Update .asf.yaml (#17409)

[noreply] [BEAM-14336] Sickbay flight delays test - dataset seems to be missing

[noreply] [BEAM-14338] Update watermark unit tests to use time.Time.Equals()

[noreply] [BEAM-14328] Tweaks to "Differences from pandas" page (#17413)

[Andrew Pilloud] [BEAM-14253] Disable broken test pending Dataflow fix

[yiru] fix: BigQuery Storage Connector trace id population missing bracket

[noreply] [BEAM-14330] Temporarily disable the clusters auto-cleanup (#17400)

[noreply] Update Beam website to release 2.38.0 (#17378)

[noreply] [BEAM-14213] Add API and construction time validation for Batched DoFns

[noreply] Minor: Update release guide regarding archive.apache.org (#17419)

[noreply] [BEAM-14017] beam_PreCommit_CommunityMetrics_Cron test failing (#17396)


------------------------------------------
[...truncated 17.07 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650539679532001462/****\022@85cb4928dc4516be66bc50d48050ce560243201f536b5f6ec849c9d9a1e57419"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/21 11:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650539679532001462/model
2022/04/21 11:14:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0421100434"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650539679532001462/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650539679532001462/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0421100434",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/21 11:14:42 Submitted job: 2022-04-21_04_14_40-5798457102032017459
2022/04/21 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-21_04_14_40-5798457102032017459?project=apache-beam-testing
2022/04/21 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-21_04_14_40-5798457102032017459
2022/04/21 11:14:42 Job state: JOB_STATE_PENDING ...
2022/04/21 11:15:12 Job still running ...
2022/04/21 11:15:42 Job still running ...
2022/04/21 11:16:12 Job still running ...
2022/04/21 11:16:42 Job still running ...
2022/04/21 11:17:12 Job still running ...
2022/04/21 11:17:42 Job still running ...
2022/04/21 11:18:12 Failed to execute job: job 2022-04-21_04_14_40-5798457102032017459 failed
panic: Failed to execute job: job 2022-04-21_04_14_40-5798457102032017459 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030a8, 0xc000120000, 0x10e1a7b, 0x19, 0xc000413df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/tldrul5vmunyq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #484

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/484/display/redirect?page=changes>

Changes:

[andyye333] Change func to PTransform

[noreply] Populate actual dataflow job id to bigquery write trace id (#17130)

[relax] mark static thread as a daemon thread

[noreply] [BEAM-13866] Add miscellaneous exec unit tests (#17363)


------------------------------------------
[...truncated 17.00 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650453269816945654/****\022@85cb4928dc4516be66bc50d48050ce560243201f536b5f6ec849c9d9a1e57419"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/20 11:14:30 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650453269816945654/model
2022/04/20 11:14:30 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0420100401"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650453269816945654/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650453269816945654/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0420100401",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/20 11:14:30 Submitted job: 2022-04-20_04_14_30-11753862685892985059
2022/04/20 11:14:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-20_04_14_30-11753862685892985059?project=apache-beam-testing
2022/04/20 11:14:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-20_04_14_30-11753862685892985059
2022/04/20 11:14:31 Job state: JOB_STATE_PENDING ...
2022/04/20 11:15:01 Job still running ...
2022/04/20 11:15:31 Job still running ...
2022/04/20 11:16:01 Job still running ...
2022/04/20 11:16:31 Job still running ...
2022/04/20 11:17:01 Job still running ...
2022/04/20 11:17:31 Job still running ...
2022/04/20 11:18:01 Failed to execute job: job 2022-04-20_04_14_30-11753862685892985059 failed
panic: Failed to execute job: job 2022-04-20_04_14_30-11753862685892985059 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030a8, 0xc0000480c0, 0x10e1a7b, 0x19, 0xc00043bdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 37s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/b5nyjx36bo4fm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #483

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/483/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14251] add output_coder_override to ExpansionRequest

[Heejong Lee] remove null

[rarokni] [BEAM-14307] Fix Slow Side input pattern bug in sample

[Heejong Lee] better error msg

[Heejong Lee] update from comments

[noreply] [BEAM-14316] Introducing KafkaIO.Read implementation compatibility

[noreply] [BEAM-14290] Address staticcheck warnings in the reflectx package

[noreply] [BEAM-14302] Simply bools in fn.go, genx_test.go (#17356)

[noreply] Merge pull request #17382: [BEAM-12356] Close DatasetService leak as


------------------------------------------
[...truncated 17.08 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650366881370824178/****\022@85cb4928dc4516be66bc50d48050ce560243201f536b5f6ec849c9d9a1e57419"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/19 11:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650366881370824178/model
2022/04/19 11:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0419100412"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650366881370824178/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650366881370824178/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0419100412",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/19 11:14:43 Submitted job: 2022-04-19_04_14_42-5524068060673337784
2022/04/19 11:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-19_04_14_42-5524068060673337784?project=apache-beam-testing
2022/04/19 11:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-19_04_14_42-5524068060673337784
2022/04/19 11:14:43 Job state: JOB_STATE_PENDING ...
2022/04/19 11:15:13 Job still running ...
2022/04/19 11:15:43 Job still running ...
2022/04/19 11:16:13 Job still running ...
2022/04/19 11:16:43 Job still running ...
2022/04/19 11:17:13 Job still running ...
2022/04/19 11:17:43 Failed to execute job: job 2022-04-19_04_14_42-5524068060673337784 failed
panic: Failed to execute job: job 2022-04-19_04_14_42-5524068060673337784 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030a8, 0xc0000480c0, 0x10e1a7b, 0x19, 0xc00033ddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/uwxanmmwnig6k

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #482

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/482/display/redirect>

Changes:


------------------------------------------
[...truncated 17.10 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650280472936844125/****\022@9c0b1bcf65831c8e96bda4ae41f18cb654b1b31e6cf6567727192bec673e5579"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/18 11:14:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650280472936844125/model
2022/04/18 11:14:33 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0418100402"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650280472936844125/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650280472936844125/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0418100402",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/18 11:14:34 Submitted job: 2022-04-18_04_14_33-18193122895259443670
2022/04/18 11:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-18_04_14_33-18193122895259443670?project=apache-beam-testing
2022/04/18 11:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-18_04_14_33-18193122895259443670
2022/04/18 11:14:34 Job state: JOB_STATE_PENDING ...
2022/04/18 11:15:04 Job still running ...
2022/04/18 11:15:34 Job still running ...
2022/04/18 11:16:04 Job still running ...
2022/04/18 11:16:34 Job still running ...
2022/04/18 11:17:04 Job still running ...
2022/04/18 11:17:34 Failed to execute job: job 2022-04-18_04_14_33-18193122895259443670 failed
panic: Failed to execute job: job 2022-04-18_04_14_33-18193122895259443670 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030a8, 0xc0000480c0, 0x10e1a7b, 0x19, 0xc00040ddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vwovcntg6bgua

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #481

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/481/display/redirect>

Changes:


------------------------------------------
[...truncated 17.10 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650194078520213343/****\022@9c0b1bcf65831c8e96bda4ae41f18cb654b1b31e6cf6567727192bec673e5579"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/17 11:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650194078520213343/model
2022/04/17 11:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0417100409"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650194078520213343/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650194078520213343/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0417100409",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/17 11:14:39 Submitted job: 2022-04-17_04_14_39-1344769180231926922
2022/04/17 11:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-17_04_14_39-1344769180231926922?project=apache-beam-testing
2022/04/17 11:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-17_04_14_39-1344769180231926922
2022/04/17 11:14:39 Job state: JOB_STATE_PENDING ...
2022/04/17 11:15:09 Job still running ...
2022/04/17 11:15:39 Job still running ...
2022/04/17 11:16:09 Job still running ...
2022/04/17 11:16:40 Job still running ...
2022/04/17 11:17:10 Job still running ...
2022/04/17 11:17:40 Failed to execute job: job 2022-04-17_04_14_39-1344769180231926922 failed
panic: Failed to execute job: job 2022-04-17_04_14_39-1344769180231926922 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030a8, 0xc000120000, 0x10e1a7b, 0x19, 0xc000571df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 14s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ljpy2yog6b77k

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #480

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/480/display/redirect?page=changes>

Changes:

[pandiana] BigQueryServicesImpl: reduce number of threads spawned by

[noreply] [BEAM-13204] Fix website bug where code tabs do not appear if the


------------------------------------------
[...truncated 17.11 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650107678106189672/****\022@9c0b1bcf65831c8e96bda4ae41f18cb654b1b31e6cf6567727192bec673e5579"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/16 11:14:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650107678106189672/model
2022/04/16 11:14:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0416100405"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650107678106189672/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650107678106189672/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0416100405",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/16 11:14:39 Submitted job: 2022-04-16_04_14_38-706150186152413936
2022/04/16 11:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-16_04_14_38-706150186152413936?project=apache-beam-testing
2022/04/16 11:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-16_04_14_38-706150186152413936
2022/04/16 11:14:39 Job state: JOB_STATE_PENDING ...
2022/04/16 11:15:09 Job still running ...
2022/04/16 11:15:39 Job still running ...
2022/04/16 11:16:09 Job still running ...
2022/04/16 11:16:39 Job still running ...
2022/04/16 11:17:09 Job still running ...
2022/04/16 11:17:39 Job still running ...
2022/04/16 11:18:09 Failed to execute job: job 2022-04-16_04_14_38-706150186152413936 failed
panic: Failed to execute job: job 2022-04-16_04_14_38-706150186152413936 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030a8, 0xc000120000, 0x10e1a7b, 0x19, 0xc000549df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 44s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/skqncvi7hsshe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #479

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/479/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Upgrade to Gradle 7.4

[Kenneth Knowles] Remove Python module dependency on Dataflow worker

[noreply] [BEAM-13925] Dont double assign committers if author or other reviewer

[noreply] [BEAM-13739] Remove deprecated shallow clone funcs (#17362)

[noreply] [BEAM-11104] Pipe Continuation to DataSource level (#17334)

[noreply] [BEAM-11105] Basic Watermark Estimation (Wall Clock Observing) (#17267)

[noreply] Respect output coder for TextIO. (#17367)

[noreply] Merge pull request #17200 from [BEAM-12164]: fix the autoscaling backlog

[noreply] [BEAM-17035] Call python3 directly when it is available. (#17366)

[noreply] Merge pull request #17375: [BEAM-8691] Declare newer


------------------------------------------
[...truncated 17.09 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1650021281970200745/****\022@9c0b1bcf65831c8e96bda4ae41f18cb654b1b31e6cf6567727192bec673e5579"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/15 11:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1650021281970200745/model
2022/04/15 11:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0415100355"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650021281970200745/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1650021281970200745/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0415100355",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/15 11:14:43 Submitted job: 2022-04-15_04_14_42-11447671674069326652
2022/04/15 11:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-15_04_14_42-11447671674069326652?project=apache-beam-testing
2022/04/15 11:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-15_04_14_42-11447671674069326652
2022/04/15 11:14:43 Job state: JOB_STATE_PENDING ...
2022/04/15 11:15:13 Job still running ...
2022/04/15 11:15:43 Job still running ...
2022/04/15 11:16:13 Job still running ...
2022/04/15 11:16:43 Job still running ...
2022/04/15 11:17:13 Job still running ...
2022/04/15 11:17:43 Job still running ...
2022/04/15 11:18:13 Failed to execute job: job 2022-04-15_04_14_42-11447671674069326652 failed
panic: Failed to execute job: job 2022-04-15_04_14_42-11447671674069326652 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x12030a8, 0xc0000480c0, 0x10e1a7b, 0x19, 0xc0003efdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/xled7o74us7o6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #478

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/478/display/redirect?page=changes>

Changes:

[relax] handle changing schemas in Storage API sink

[noreply] Fix a couple style issues (#17361)

[noreply] [BEAM-14287] Clean up staticcheck warnings in graph/coder (#17337)

[noreply] Improvements to dataflow job service for non-Python jobs. (#17338)

[noreply] Bump minimist (#17290)

[noreply] Bump ansi-regex (#17291)

[noreply] Bump nanoid (#17292)

[noreply] Bump lodash (#17293)

[noreply] Bump url-parse (#17294)

[noreply] Bump moment (#17328)

[noreply] Merge pull request #15549 from [BEAM-11997] Changed RedisIO


------------------------------------------
[...truncated 17.03 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649934873184787099/****\022@2911f6b8ba3d8e97428245632c63b66300707f6bb148b6365960985ac42cd627"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/14 11:14:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649934873184787099/model
2022/04/14 11:14:33 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0414100416"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649934873184787099/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649934873184787099/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0414100416",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/14 11:14:34 Submitted job: 2022-04-14_04_14_33-13060660996209464573
2022/04/14 11:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-14_04_14_33-13060660996209464573?project=apache-beam-testing
2022/04/14 11:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-14_04_14_33-13060660996209464573
2022/04/14 11:14:34 Job state: JOB_STATE_PENDING ...
2022/04/14 11:15:04 Job still running ...
2022/04/14 11:15:34 Job still running ...
2022/04/14 11:16:04 Job still running ...
2022/04/14 11:16:34 Job still running ...
2022/04/14 11:17:04 Job still running ...
2022/04/14 11:17:34 Job still running ...
2022/04/14 11:18:04 Failed to execute job: job 2022-04-14_04_14_33-13060660996209464573 failed
panic: Failed to execute job: job 2022-04-14_04_14_33-13060660996209464573 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fd9e8, 0xc0000480c0, 0x10dcb83, 0x19, 0xc000317df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rzk5y4z5bvq2y

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #477

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/477/display/redirect?page=changes>

Changes:

[Valentyn Tymofieiev] Add remaining Dataflow test suites for Python 3.9.

[Heejong Lee] [BEAM-14232] Only resolve artifacts in expanded environments for Java

[noreply] Fix test ordering issue (#17350)

[buqian] Do not pass null to MoreObjects.firstNonNull as default value

[ningkang0957] [BEAM-14288] Fixed flaky test

[noreply] [BEAM-14277] Disables Spanner change streams tests (#17346)

[noreply] [BEAM-14219] Run cleanup script to remove stale prebuilt SDK container

[Heejong Lee] [BEAM-14300] Fix Java precommit failure

[noreply] [BEAM-14116] Rollback "Chunk commit requests dynamically (#17004)"

[noreply] [BEAM-13982] A base class for run inference (#16970)

[ningkang0957] Enumerates all possible expected strings when asserting

[noreply] [BEAM-13966] Add pivot(), a non-deferred column operation on categorical


------------------------------------------
[...truncated 17.12 KB...]
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649848471585277343/****\022@ec738dc50b929347cf0fef19b7c9151ad489d50f4f93ee26f84847327ea05a78"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/13 11:14:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649848471585277343/model
2022/04/13 11:14:32 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0413100400"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649848471585277343/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649848471585277343/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0413100400",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/13 11:14:33 Submitted job: 2022-04-13_04_14_32-14704192372225425542
2022/04/13 11:14:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-13_04_14_32-14704192372225425542?project=apache-beam-testing
2022/04/13 11:14:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-13_04_14_32-14704192372225425542
2022/04/13 11:14:33 Job state: JOB_STATE_PENDING ...
2022/04/13 11:15:03 Job still running ...
2022/04/13 11:15:33 Job still running ...
2022/04/13 11:16:03 Job still running ...
2022/04/13 11:16:33 Job still running ...
2022/04/13 11:17:03 Job still running ...
2022/04/13 11:17:33 Job still running ...
2022/04/13 11:18:03 Job still running ...
2022/04/13 11:18:33 Job still running ...
2022/04/13 11:19:03 Job still running ...
2022/04/13 11:19:33 Job still running ...
2022/04/13 11:20:04 Failed to execute job: job 2022-04-13_04_14_32-14704192372225425542 failed
panic: Failed to execute job: job 2022-04-13_04_14_32-14704192372225425542 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fd9e8, 0xc000120000, 0x10dcb83, 0x19, 0xc00038bdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 38s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6njsx5qoha5pi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #476

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/476/display/redirect?page=changes>

Changes:

[kamil.bregula] [BEAM-14215] Improve argument validation in SnowflakeIO

[benjamin.gonzalez] [BEAM-14013] Add PreCommit Kotlin examples Jenkins Job

[Andrew Pilloud] [BEAM-13151] Support multiple layers of AutoValue nesting

[Heejong Lee] [BEAM-14233] Merge requirements from expanded response for Java External

[benjamin.gonzalez] [BEAM-14013] Add spark, direct, flink runners as triggers for Kotlin

[noreply] [BEAM-13898] Add tests to the pubsubx package. (#17324)

[noreply] [BEAM-14285] Clean up Staticcheck Warnings in io packages (#17336)

[noreply] [BEAM-14187] Fix concurrency issue in IsmReaderImpl (#17201)

[noreply] [BEAM-14288] Skip flaking test

[noreply] Simplify specifying additional dependencies in Go SDK in XLang IOs

[noreply] [BEAM-14240] Clean staticcheck warnings in runner packages (#17340)

[Daniel Oliveira] [BEAM-13538] Workaround to fix go-licenses crash.


------------------------------------------
[...truncated 17.09 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649762079829994480/****\022@ec738dc50b929347cf0fef19b7c9151ad489d50f4f93ee26f84847327ea05a78"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/12 11:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649762079829994480/model
2022/04/12 11:14:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0412100419"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649762079829994480/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649762079829994480/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0412100419",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/12 11:14:40 Submitted job: 2022-04-12_04_14_40-17115388949738905471
2022/04/12 11:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-12_04_14_40-17115388949738905471?project=apache-beam-testing
2022/04/12 11:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-12_04_14_40-17115388949738905471
2022/04/12 11:14:41 Job state: JOB_STATE_PENDING ...
2022/04/12 11:15:11 Job still running ...
2022/04/12 11:15:41 Job still running ...
2022/04/12 11:16:11 Job still running ...
2022/04/12 11:16:41 Job still running ...
2022/04/12 11:17:11 Job still running ...
2022/04/12 11:17:41 Job still running ...
2022/04/12 11:18:11 Failed to execute job: job 2022-04-12_04_14_40-17115388949738905471 failed
panic: Failed to execute job: job 2022-04-12_04_14_40-17115388949738905471 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fd9e8, 0xc0000480c0, 0x10dcb83, 0x19, 0xc00040bdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/hibrwwp224lc6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #475

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/475/display/redirect>

Changes:


------------------------------------------
[...truncated 17.08 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649675678009445355/****\022@629cba4a7d50a519e2588f8f3680a3e50454c5274f97b39d65528b9c3861726f"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/11 11:14:38 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649675678009445355/model
2022/04/11 11:14:38 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0411100418"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649675678009445355/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649675678009445355/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0411100418",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/11 11:14:41 Submitted job: 2022-04-11_04_14_38-12680757379265375481
2022/04/11 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-11_04_14_38-12680757379265375481?project=apache-beam-testing
2022/04/11 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-11_04_14_38-12680757379265375481
2022/04/11 11:14:41 Job state: JOB_STATE_PENDING ...
2022/04/11 11:15:11 Job still running ...
2022/04/11 11:15:41 Job still running ...
2022/04/11 11:16:11 Job still running ...
2022/04/11 11:16:41 Job still running ...
2022/04/11 11:17:11 Job still running ...
2022/04/11 11:17:41 Job still running ...
2022/04/11 11:18:11 Failed to execute job: job 2022-04-11_04_14_38-12680757379265375481 failed
panic: Failed to execute job: job 2022-04-11_04_14_38-12680757379265375481 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc268, 0xc000120000, 0x10db62f, 0x19, 0xc000593df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/exoaffdvw56zu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #474

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/474/display/redirect?page=changes>

Changes:

[chamikaramj] Re-raise exceptions swallowed in several Python I/O connectors

[noreply] Merge pull request #16928: [BEAM-11971] Re add reverted timer


------------------------------------------
[...truncated 17.08 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649589281197793823/****\022@629cba4a7d50a519e2588f8f3680a3e50454c5274f97b39d65528b9c3861726f"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/10 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649589281197793823/model
2022/04/10 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0410100420"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649589281197793823/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649589281197793823/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0410100420",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/10 11:14:42 Submitted job: 2022-04-10_04_14_41-13665346234990338622
2022/04/10 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-10_04_14_41-13665346234990338622?project=apache-beam-testing
2022/04/10 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-10_04_14_41-13665346234990338622
2022/04/10 11:14:42 Job state: JOB_STATE_PENDING ...
2022/04/10 11:15:12 Job still running ...
2022/04/10 11:15:42 Job still running ...
2022/04/10 11:16:12 Job still running ...
2022/04/10 11:16:42 Job still running ...
2022/04/10 11:17:12 Job still running ...
2022/04/10 11:17:42 Job still running ...
2022/04/10 11:18:12 Failed to execute job: job 2022-04-10_04_14_41-13665346234990338622 failed
panic: Failed to execute job: job 2022-04-10_04_14_41-13665346234990338622 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc268, 0xc000120000, 0x10db62f, 0x19, 0xc00060fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 45s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/tuttjchdzo3vi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #473

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/473/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-11714] Change spotBugs jenkins config

[Robert Bradshaw] Cleanup docs on Shared.

[Kyle Weaver] Nit: correct description for precommit cron jobs.

[benjamin.gonzalez] [BEAM-11714] Add dummy class for testing

[benjamin.gonzalez] [BEAM-11714] Remove dummy class used for testing

[benjamin.gonzalez] [BEAM-11714] Spotbugs print toJenkins UI precommit_Java17

[noreply] [BEAM-13767] Remove eclipse plugin as it generates a lot of unused tasks

[noreply] [BEAM-10708] Updated beam_sql error message (#17314)

[noreply] [BEAM-14281] add as_deterministic_coder to nullable coder (#17322)

[noreply] Improvements to Beam/Spark quickstart. (#17129)

[chamikaramj] Disable BigQueryIOStorageWriteIT for Runner v2 test suite


------------------------------------------
[...truncated 17.19 KB...]
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649502881498211980/****\022@629cba4a7d50a519e2588f8f3680a3e50454c5274f97b39d65528b9c3861726f"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/09 11:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649502881498211980/model
2022/04/09 11:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0409100409"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649502881498211980/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649502881498211980/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0409100409",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/09 11:14:42 Submitted job: 2022-04-09_04_14_42-7191336334547531738
2022/04/09 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-09_04_14_42-7191336334547531738?project=apache-beam-testing
2022/04/09 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-09_04_14_42-7191336334547531738
2022/04/09 11:14:43 Job state: JOB_STATE_PENDING ...
2022/04/09 11:15:13 Job still running ...
2022/04/09 11:15:43 Job still running ...
2022/04/09 11:16:13 Job still running ...
2022/04/09 11:16:43 Job still running ...
2022/04/09 11:17:13 Job still running ...
2022/04/09 11:17:43 Job still running ...
2022/04/09 11:18:13 Job still running ...
2022/04/09 11:18:43 Job still running ...
2022/04/09 11:19:13 Job still running ...
2022/04/09 11:19:43 Job still running ...
2022/04/09 11:20:13 Failed to execute job: job 2022-04-09_04_14_42-7191336334547531738 failed
panic: Failed to execute job: job 2022-04-09_04_14_42-7191336334547531738 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc268, 0xc000120000, 0x10db62f, 0x19, 0xc00061fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/q3doywhmjb4iw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #472

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/472/display/redirect?page=changes>

Changes:

[johnjcasey] [BEAM-10529] add java and generic components of nullable xlang tests

[johnjcasey] [BEAM-10529] fix test case

[johnjcasey] [BEAM-10529] add coders and typehints to support nullable xlang coders

[johnjcasey] [BEAM-10529] update external builder to support nullable coder

[johnjcasey] [BEAM-10529] clean up coders.py

[johnjcasey] [BEAM-10529] add coder translation test

[johnjcasey] [BEAM-10529] add additional check to typecoder to not accidentally

[johnjcasey] [BEAM-10529] add test to retrieve nullable coder from typehint

[johnjcasey] [BEAM-10529] run spotless

[johnjcasey] [BEAM-10529] add go nullable coder

[johnjcasey] [BEAM-10529] cleanup extra println

[johnjcasey] [BEAM-10529] improve comments, clean up python

[bulat.safiullin] [BEAM-13992] [Website] update Contribute/Code Contribution Guide page

[bulat.safiullin] [BEAM-13992] [Website] change text, transfer tag a

[bulat.safiullin] [BEAM-13992] [Website] change code tags

[bulat.safiullin] [BEAM-13992] [Website] change text

[bulat.safiullin] [BEAM-13992] [Website] change text and links, add empty lines

[bulat.safiullin] [BEAM-13991] [Website] change links, add contribute file

[bulat.safiullin] [BEAM-13991] [Website] add content, add styles

[bulat.safiullin] [BEAM-13991] [Website] add images, add styles, delete spaces

[bulat.safiullin] [BEAM-13991] [Website] change url and aliases, delete bullet points

[bulat.safiullin] [BEAM-13991] [Website] add empty line

[bulat.safiullin] [BEAM-13992] [Website] change links, change text

[bulat.safiullin] [BEAM-13992] [Website] change links, add text, add dots

[bulat.safiullin] [BEAM-13992] [Website] change links, change text

[bulat.safiullin] [BEAM-13991] [Website] change styles, change quotes

[bulat.safiullin] [BEAM-13991] [Website] change link color

[bulat.safiullin] [BEAM-13992] [Website] change text, delete whitespace

[bulat.safiullin] [BEAM-13991] [Website] change text

[bulat.safiullin] [BEAM-13992] [Website] update text

[bulat.safiullin] [BEAM-13991] [Website] added changes from PR 13992, changed get-starting

[shivrajw] [BEAM-14236] Parquet IO support for list to conform with Apache Parquet

[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -

[chamikaramj] Sets 'sdk_harness_container_images' property for all Dataflow jobs -

[mmack] [BEAM-14104] Support shard aware aggregation in Kinesis writer.

[noreply] [BEAM-13015] Lookup the container for the step once when registering

[noreply] [BEAM-14175] Log read loop abort at debug rather than error (#17183)

[noreply] [BEAM-11745] Fix author list rendering (#17308)

[noreply] [BEAM-14144] Record JFR profiles when GC thrashing is detected (#17151)

[noreply] Factors enable_prime flag in when checking use_unified_worker conditions

[noreply] [BEAM-11104] Add ProcessContinuation type to Go SDK (#17265)

[noreply] BEAM-13939: Restructure Protos to fix namespace conflicts (#16961)

[noreply] [BEAM-14270] Mark {Snowflake/BigQuery}Services as @Internal (#17309)

[noreply] [BEAM-13901] Add unit tests for graphx/cogbk.go

[noreply] [BEAM-14259, BEAM-14266] Remove unused function, replace use of ptypes

[noreply] [BEAM-14274] Fix staticcheck warnings in pipelinex (#17311)

[noreply] [BEAM-13857] Switched Go IT script to using Go flags for expansion

[noreply] Update python beam-master container image. (#17313)


------------------------------------------
[...truncated 17.06 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649416483967952020/****\022@629cba4a7d50a519e2588f8f3680a3e50454c5274f97b39d65528b9c3861726f"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/08 11:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649416483967952020/model
2022/04/08 11:14:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0408100412"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649416483967952020/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649416483967952020/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0408100412",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/08 11:14:45 Submitted job: 2022-04-08_04_14_44-12078808887697128389
2022/04/08 11:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-08_04_14_44-12078808887697128389?project=apache-beam-testing
2022/04/08 11:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-08_04_14_44-12078808887697128389
2022/04/08 11:14:45 Job state: JOB_STATE_PENDING ...
2022/04/08 11:15:15 Job still running ...
2022/04/08 11:15:45 Job still running ...
2022/04/08 11:16:15 Job still running ...
2022/04/08 11:16:45 Job still running ...
2022/04/08 11:17:15 Job still running ...
2022/04/08 11:17:45 Job still running ...
2022/04/08 11:18:15 Failed to execute job: job 2022-04-08_04_14_44-12078808887697128389 failed
panic: Failed to execute job: job 2022-04-08_04_14_44-12078808887697128389 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11fc268, 0xc000120000, 0x10db62f, 0x19, 0xc000625df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/qkysa35lmuftq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #471

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/471/display/redirect?page=changes>

Changes:

[noreply] Avoid pr-bot state desync (#17299)

[noreply] [BEAM-14259] Clean up staticcheck warnings in the exec package (#17285)

[noreply] Minor: Prefer registered schema in SQL docs (#17298)

[Kyle Weaver] [BEAM-14262] Update plugins for Dockerized Jenkins.

[Kyle Weaver] Add ansicolor and ws-cleanup plugins.

[noreply] [Playground] add meta tags (#17207)

[noreply] fixes golint and deprecated issues in recent Go SDK import (#17304)

[noreply] [BEAM-14266] Replace deprecated ptypes package uses (#17302)

[noreply] [BEAM-11936] Fix rawtypes warnings in SnowflakeIO (#17257)

[noreply] Merge pull request #17262: [BEAM-14244] Use the supplied output


------------------------------------------
[...truncated 17.16 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649330083458269917/****\022@0f71fe76bfc18b8571d9c20cbb1dad6e925c41e123a1212ff6e2aa1aaea1c465"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/07 11:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649330083458269917/model
2022/04/07 11:14:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0407100421"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649330083458269917/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649330083458269917/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0407100421",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/07 11:14:44 Submitted job: 2022-04-07_04_14_44-11745247403150496542
2022/04/07 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-07_04_14_44-11745247403150496542?project=apache-beam-testing
2022/04/07 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-07_04_14_44-11745247403150496542
2022/04/07 11:14:44 Job state: JOB_STATE_PENDING ...
2022/04/07 11:15:14 Job still running ...
2022/04/07 11:15:44 Job still running ...
2022/04/07 11:16:14 Job still running ...
2022/04/07 11:16:44 Job still running ...
2022/04/07 11:17:15 Job still running ...
2022/04/07 11:17:45 Job still running ...
2022/04/07 11:18:15 Failed to execute job: job 2022-04-07_04_14_44-11745247403150496542 failed
panic: Failed to execute job: job 2022-04-07_04_14_44-11745247403150496542 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11f7c68, 0xc000120000, 0x10d7722, 0x19, 0xc000775df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7gvvj2lk7upzq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #470

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/470/display/redirect?page=changes>

Changes:

[bingyeli] update query

[Robert Bradshaw] [BEAM-14250] Fix coder registration for types defined in __main__.

[johnjcasey] [BEAM-14256] update SpEL dependency to 5.3.18.RELEASE

[johnjcasey] [BEAM-14256] remove .RELEASE

[dannymccormick] Fix dependency issue causing failures

[Kyle Weaver] [BEAM-9649] Add region option to Mongo Dataflow test.

[noreply] Allow get_coder(None).

[noreply] [BEAM-13015] Disable retries for fnapi grpc channels which otherwise

[noreply] [BEAM-13952] Sickbay

[noreply] BEAM-14235 parquetio module does not parse PEP-440 compliant Pyarrow

[noreply] [Website] Contribution guide page indent bug fix (#17287)

[noreply] [BEAM-10976] Document go sdk bundle finalization (#17048)

[noreply] [BEAM-13829] Expose status API from Go SDK Harness (#16957)


------------------------------------------
[...truncated 17.06 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649243681640969513/****\022@1e3e126f4d00f5f1ed149a58c9a69ab4d8f84a845efb4417a4bbd3e3cd07f96f"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/06 11:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649243681640969513/model
2022/04/06 11:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0406100422"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649243681640969513/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649243681640969513/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0406100422",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/06 11:14:43 Submitted job: 2022-04-06_04_14_42-6138320595935682942
2022/04/06 11:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-06_04_14_42-6138320595935682942?project=apache-beam-testing
2022/04/06 11:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-06_04_14_42-6138320595935682942
2022/04/06 11:14:43 Job state: JOB_STATE_PENDING ...
2022/04/06 11:15:13 Job still running ...
2022/04/06 11:15:43 Job still running ...
2022/04/06 11:16:13 Job still running ...
2022/04/06 11:16:43 Job still running ...
2022/04/06 11:17:13 Job still running ...
2022/04/06 11:17:43 Job still running ...
2022/04/06 11:18:13 Failed to execute job: job 2022-04-06_04_14_42-6138320595935682942 failed
panic: Failed to execute job: job 2022-04-06_04_14_42-6138320595935682942 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11f7be8, 0xc000120000, 0x10d7722, 0x19, 0xc000573df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/k65vcmtzwv234

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #469

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/469/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-8970] Add docs to run wordcount example on portable Spark Runner

[Kiley Sok] Update python container version

[benjamin.gonzalez] [BEAM-8970] Add period to end of sentence

[Kyle Weaver] Add self-descriptive message for expected errors.

[noreply] Add --dataflowServiceOptions=enable_prime to useUnifiedWorker conditions

[noreply] [BEAM-10529] nullable xlang coder (#16923)

[noreply] Fix go fmt break in core/typex/special.go (#17266)

[noreply] [BEAM-5436] Add doc page on Go cross compilation. (#17256)

[noreply] Pr-bot Don't count all reviews as approvals (#17269)

[noreply] Fix postcommits (#17263)

[noreply] [BEAM-14241] Address staticcheck warnings in boot.go (#17264)

[noreply] [BEAM-14157] GrpcWindmillServer: Use stream specific boolean to do

[noreply] [BEAM-10582] Allow (and test) pyarrow 7 (#17229)

[noreply] [BEAM-13519] Solve race issues when the server responds with an error


------------------------------------------
[...truncated 17.14 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      capabilities: "beam:coder:nullable:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649157286258528253/****\022@8046fbe52cf5f4293e458797d60b31c503962ece488c99cc19f44aebed3a7ef6"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/05 11:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649157286258528253/model
2022/04/05 11:14:46 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0405100423"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649157286258528253/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649157286258528253/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0405100423",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/05 11:14:47 Submitted job: 2022-04-05_04_14_46-17001410300983972092
2022/04/05 11:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-05_04_14_46-17001410300983972092?project=apache-beam-testing
2022/04/05 11:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-05_04_14_46-17001410300983972092
2022/04/05 11:14:47 Job state: JOB_STATE_PENDING ...
2022/04/05 11:15:18 Job still running ...
2022/04/05 11:15:48 Job still running ...
2022/04/05 11:16:18 Job still running ...
2022/04/05 11:16:48 Job still running ...
2022/04/05 11:17:18 Job still running ...
2022/04/05 11:17:48 Job still running ...
2022/04/05 11:18:18 Failed to execute job: job 2022-04-05_04_14_46-17001410300983972092 failed
panic: Failed to execute job: job 2022-04-05_04_14_46-17001410300983972092 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1156728, 0xc000120000, 0x1043608, 0x19, 0xc00059fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gaw3d4pgeiy5i

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #468

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/468/display/redirect>

Changes:


------------------------------------------
[...truncated 17.00 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1649070874009611219/****\022@23a219426777fd8b60715d3ad41c467cc17812f4488352673255ecf78153c1d4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/04 11:14:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1649070874009611219/model
2022/04/04 11:14:34 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0404100407"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649070874009611219/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1649070874009611219/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0404100407",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/04 11:14:35 Submitted job: 2022-04-04_04_14_34-16703473570303790622
2022/04/04 11:14:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-04_04_14_34-16703473570303790622?project=apache-beam-testing
2022/04/04 11:14:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-04_04_14_34-16703473570303790622
2022/04/04 11:14:35 Job state: JOB_STATE_PENDING ...
2022/04/04 11:15:05 Job still running ...
2022/04/04 11:15:35 Job still running ...
2022/04/04 11:16:05 Job still running ...
2022/04/04 11:16:35 Job still running ...
2022/04/04 11:17:05 Job still running ...
2022/04/04 11:17:35 Job still running ...
2022/04/04 11:18:05 Failed to execute job: job 2022-04-04_04_14_34-16703473570303790622 failed
panic: Failed to execute job: job 2022-04-04_04_14_34-16703473570303790622 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1155228, 0xc000120000, 0x10422a3, 0x19, 0xc00042fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wqwhmpaf6xsey

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #467

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/467/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14143] Simplifies the ExternalPythonTransform API (#17101)


------------------------------------------
[...truncated 17.06 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648984483468111500/****\022@23a219426777fd8b60715d3ad41c467cc17812f4488352673255ecf78153c1d4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/03 11:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648984483468111500/model
2022/04/03 11:14:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0403100430"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648984483468111500/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648984483468111500/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0403100430",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/03 11:14:44 Submitted job: 2022-04-03_04_14_44-5125536268897876650
2022/04/03 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-03_04_14_44-5125536268897876650?project=apache-beam-testing
2022/04/03 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-03_04_14_44-5125536268897876650
2022/04/03 11:14:44 Job state: JOB_STATE_PENDING ...
2022/04/03 11:15:14 Job still running ...
2022/04/03 11:15:44 Job still running ...
2022/04/03 11:16:14 Job still running ...
2022/04/03 11:16:44 Job still running ...
2022/04/03 11:17:14 Job still running ...
2022/04/03 11:17:44 Job still running ...
2022/04/03 11:18:15 Failed to execute job: job 2022-04-03_04_14_44-5125536268897876650 failed
panic: Failed to execute job: job 2022-04-03_04_14_44-5125536268897876650 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1155228, 0xc000120000, 0x10422a3, 0x19, 0xc0003f9df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/cqjdsn6trclfa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #466

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/466/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-14133] Fix potential NPE in BigQueryServicesImpl.getErrorInfo

[Robert Bradshaw] Revert "Revert "[BEAM-14038] Auto-startup for Python expansion service.

[Robert Bradshaw] Skip failing test for now.

[Kyle Weaver] [BEAM-14225] load balance jenkins jobs

[noreply] [BEAM-14153] Reshuffled Row Coder PCollection used as Side Input cause

[noreply] delint go sdk (#17247)

[Heejong Lee] add test

[noreply] Merge pull request #16841 from [BEAM-8823] Make FnApiRunner work by

[noreply] [BEAM-14192] Update legacy container version (#17210)

[noreply] Fix mishandling of API with BQIO (#17211)

[noreply] [BEAM-14221] Update documentation with Flink on Dataproc features

[Kiley Sok] Revert "[BEAM-14190] Python sends dataflow schema field"


------------------------------------------
[...truncated 16.98 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648898070994985854/****\022@23a219426777fd8b60715d3ad41c467cc17812f4488352673255ecf78153c1d4"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/02 11:14:31 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648898070994985854/model
2022/04/02 11:14:31 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0402100412"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648898070994985854/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648898070994985854/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0402100412",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/02 11:14:32 Submitted job: 2022-04-02_04_14_31-16496090554981658639
2022/04/02 11:14:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-02_04_14_31-16496090554981658639?project=apache-beam-testing
2022/04/02 11:14:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-02_04_14_31-16496090554981658639
2022/04/02 11:14:32 Job state: JOB_STATE_PENDING ...
2022/04/02 11:15:02 Job still running ...
2022/04/02 11:15:32 Job still running ...
2022/04/02 11:16:02 Job still running ...
2022/04/02 11:16:32 Job still running ...
2022/04/02 11:17:02 Job still running ...
2022/04/02 11:17:32 Job still running ...
2022/04/02 11:18:02 Failed to execute job: job 2022-04-02_04_14_31-16496090554981658639 failed
panic: Failed to execute job: job 2022-04-02_04_14_31-16496090554981658639 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1155228, 0xc000120000, 0x10422a3, 0x19, 0xc000619df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/xff24q3evdci4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #465

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/465/display/redirect?page=changes>

Changes:

[bulat.safiullin] [BEAM-14164] [Website] change styles

[Andrew Pilloud] [BEAM-14190] Python sends dataflow schema field

[noreply] [BEAM-14179] Fix possibly null value

[noreply] [BEAM-12815] Try to fix flaky Flink Post Commit (#17227)

[noreply] Add a portable job server that proxies the Dataflow backend. (#17189)

[noreply] [BEAM-14130] Implement JupyterLab extension for managing Dataproc

[Andrew Pilloud] [BEAM-13741] Remove forced calcite dependency from BaseBeamTable

[noreply] [BEAM-13951] Update release guide with pointers on updating


------------------------------------------
[...truncated 17.11 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648811684182334098/****\022@e53a4edea8de8ceb6d123f5c9c0f769ecf840a8d6a219078f197db82d332bc37"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/04/01 11:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648811684182334098/model
2022/04/01 11:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0401100405"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648811684182334098/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648811684182334098/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0401100405",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/04/01 11:14:48 Submitted job: 2022-04-01_04_14_45-17142456166788430096
2022/04/01 11:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-04-01_04_14_45-17142456166788430096?project=apache-beam-testing
2022/04/01 11:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-04-01_04_14_45-17142456166788430096
2022/04/01 11:14:48 Job state: JOB_STATE_PENDING ...
2022/04/01 11:15:18 Job still running ...
2022/04/01 11:15:48 Job still running ...
2022/04/01 11:16:18 Job still running ...
2022/04/01 11:16:48 Job still running ...
2022/04/01 11:17:19 Job still running ...
2022/04/01 11:17:49 Job still running ...
2022/04/01 11:18:19 Failed to execute job: job 2022-04-01_04_14_45-17142456166788430096 failed
panic: Failed to execute job: job 2022-04-01_04_14_45-17142456166788430096 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1153508, 0xc000120000, 0x10408a3, 0x19, 0xc00076bdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bldyrk7fzw4u4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #464

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/464/display/redirect?page=changes>

Changes:

[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn

[brachipa] [BEAM-14094]Fix null pointer exception in HllCountInitFn

[egalpin] [BEAM-14003] Adds compat for Elasticsearch 8.0.0

[egalpin] [BEAM-13136] Removes support for Elasticsearch 2.x

[noreply] Merge pull request #17149 from [BEAM-13883] [Playground] Increase test

[Kiley Sok] ignore test

[noreply] [BEAM-13948] Add unstack(), a non-deferred column operation on

[noreply] [BEAM-10976] Bundle finalization: E2E support (#17045)


------------------------------------------
[...truncated 17.01 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648725276712380668/****\022@e53a4edea8de8ceb6d123f5c9c0f769ecf840a8d6a219078f197db82d332bc37"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/31 11:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648725276712380668/model
2022/03/31 11:14:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0331100403"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648725276712380668/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648725276712380668/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0331100403",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/31 11:14:37 Submitted job: 2022-03-31_04_14_37-17256432497971828383
2022/03/31 11:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-31_04_14_37-17256432497971828383?project=apache-beam-testing
2022/03/31 11:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-31_04_14_37-17256432497971828383
2022/03/31 11:14:37 Job state: JOB_STATE_PENDING ...
2022/03/31 11:15:08 Job still running ...
2022/03/31 11:15:38 Job still running ...
2022/03/31 11:16:08 Job still running ...
2022/03/31 11:16:38 Job still running ...
2022/03/31 11:17:08 Job still running ...
2022/03/31 11:17:38 Job still running ...
2022/03/31 11:18:08 Failed to execute job: job 2022-03-31_04_14_37-17256432497971828383 failed
panic: Failed to execute job: job 2022-03-31_04_14_37-17256432497971828383 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1153508, 0xc000120000, 0x10408a3, 0x19, 0xc000587df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 42s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vl3bvcsbvluwu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #463

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/463/display/redirect?page=changes>

Changes:

[vachan] Update display data to include BQ information.

[noreply] Revert "[BEAM-14084] iterable_input_value_types changed from list to

[chamikaramj] Convert URLs to local jars when constructing filesToStage

[Valentyn Tymofieiev] Ensure the removed option prebuild_sdk_container_base_image not used on

[noreply] [BEAM-13314]Revise recommendations to manage Python pipeline

[noreply] Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for

[noreply] Merge pull request #17080 from [BEAM-13880] [Playground] Increase test

[noreply] Merge pull request #17050 from [BEAM-13877] [Playground] Increase test

[noreply] [BEAM-14200] Improve SamzaJobInvoker extensibility (#17212)

[noreply] Merge pull request #17148 from [BEAM-14042] [playground] Scroll imports

[noreply] [BEAM-13918] Increase datastoreio go sdk unit test coverage (#17173)

[noreply] Merge pull request #16819: [BEAM-13806] Adding test suite for Go x-lang


------------------------------------------
[...truncated 17.08 KB...]
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648638879189875506/****\022@9afffb8e4cef1a61d8ae14a2d67fa4de813a832694f1bcd15c0b504536f513f8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/30 11:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648638879189875506/model
2022/03/30 11:14:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0330100353"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648638879189875506/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648638879189875506/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0330100353",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/30 11:14:40 Submitted job: 2022-03-30_04_14_40-9839155162107295047
2022/03/30 11:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-30_04_14_40-9839155162107295047?project=apache-beam-testing
2022/03/30 11:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-30_04_14_40-9839155162107295047
2022/03/30 11:14:40 Job state: JOB_STATE_PENDING ...
2022/03/30 11:15:10 Job still running ...
2022/03/30 11:15:41 Job still running ...
2022/03/30 11:16:11 Job still running ...
2022/03/30 11:16:41 Job still running ...
2022/03/30 11:17:11 Job still running ...
2022/03/30 11:17:41 Job still running ...
2022/03/30 11:18:11 Job still running ...
2022/03/30 11:18:41 Job still running ...
2022/03/30 11:19:11 Failed to execute job: job 2022-03-30_04_14_40-9839155162107295047 failed
panic: Failed to execute job: job 2022-03-30_04_14_40-9839155162107295047 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc0000480c0, 0x103ebdf, 0x19, 0xc00042fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lstk7t47ny7im

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #462

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/462/display/redirect?page=changes>

Changes:

[hengfeng] feat: remove the metadata table after the pipeline finishes

[thiagotnunes] test: add test for metadata table dropping

[noreply] Minor: Add warning about pubsub client to Beam 2.36.0 blog (#17188)

[noreply] [BEAM-14177] Fix GBK re-iteration caching for portable runners. (#17184)

[noreply] Merge pull request #17187: [BEAM-14181] Make sure to evict connections

[noreply] Only reset transform.label if it is correctly assigned (#17192)

[noreply] [BEAM-12641] Use google-auth instead of oauth2client for GCP auth

[Robert Bradshaw] [BEAM-14163] Fix typo in single core per container logic.

[thiagotnunes] test: disable SpannerIO.readChangeStream test

[noreply] Merge pull request #17164 from [BEAM-14140][Playground] Fix Deploy

[noreply] Merge pull request #16855 from [BEAM-13938][Playground] Increase test


------------------------------------------
[...truncated 17.09 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648552480016432291/****\022@9afffb8e4cef1a61d8ae14a2d67fa4de813a832694f1bcd15c0b504536f513f8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/29 11:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648552480016432291/model
2022/03/29 11:14:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0329100409"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648552480016432291/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648552480016432291/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0329100409",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/29 11:14:41 Submitted job: 2022-03-29_04_14_40-16311174473530701986
2022/03/29 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-29_04_14_40-16311174473530701986?project=apache-beam-testing
2022/03/29 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-29_04_14_40-16311174473530701986
2022/03/29 11:14:41 Job state: JOB_STATE_PENDING ...
2022/03/29 11:15:11 Job still running ...
2022/03/29 11:15:41 Job still running ...
2022/03/29 11:16:11 Job still running ...
2022/03/29 11:16:42 Job still running ...
2022/03/29 11:17:12 Job still running ...
2022/03/29 11:17:42 Job still running ...
2022/03/29 11:18:12 Failed to execute job: job 2022-03-29_04_14_40-16311174473530701986 failed
panic: Failed to execute job: job 2022-03-29_04_14_40-16311174473530701986 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc0000480c0, 0x103ebdf, 0x19, 0xc0004addf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lulwk3gjha3hy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #461

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/461/display/redirect>

Changes:


------------------------------------------
[...truncated 17.12 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648466084988285233/****\022@9afffb8e4cef1a61d8ae14a2d67fa4de813a832694f1bcd15c0b504536f513f8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/28 11:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648466084988285233/model
2022/03/28 11:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0328100402"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648466084988285233/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648466084988285233/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0328100402",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/28 11:14:46 Submitted job: 2022-03-28_04_14_45-17532283689878936615
2022/03/28 11:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-28_04_14_45-17532283689878936615?project=apache-beam-testing
2022/03/28 11:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-28_04_14_45-17532283689878936615
2022/03/28 11:14:46 Job state: JOB_STATE_PENDING ...
2022/03/28 11:15:16 Job still running ...
2022/03/28 11:15:46 Job still running ...
2022/03/28 11:16:16 Job still running ...
2022/03/28 11:16:46 Job still running ...
2022/03/28 11:17:16 Job still running ...
2022/03/28 11:17:46 Job still running ...
2022/03/28 11:18:17 Job still running ...
2022/03/28 11:18:47 Failed to execute job: job 2022-03-28_04_14_45-17532283689878936615 failed
panic: Failed to execute job: job 2022-03-28_04_14_45-17532283689878936615 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc00019a000, 0x103ebdf, 0x19, 0xc0003bddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 24s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/kwspgxjjc4xjy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #460

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/460/display/redirect>

Changes:


------------------------------------------
[...truncated 17.16 KB...]
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648379678670659851/****\022@9afffb8e4cef1a61d8ae14a2d67fa4de813a832694f1bcd15c0b504536f513f8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/27 11:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648379678670659851/model
2022/03/27 11:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0327100404"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648379678670659851/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648379678670659851/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0327100404",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/27 11:14:39 Submitted job: 2022-03-27_04_14_39-13703950372204846708
2022/03/27 11:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-27_04_14_39-13703950372204846708?project=apache-beam-testing
2022/03/27 11:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-27_04_14_39-13703950372204846708
2022/03/27 11:14:39 Job state: JOB_STATE_PENDING ...
2022/03/27 11:15:09 Job still running ...
2022/03/27 11:15:39 Job still running ...
2022/03/27 11:16:10 Job still running ...
2022/03/27 11:16:40 Job still running ...
2022/03/27 11:17:10 Job still running ...
2022/03/27 11:17:40 Job still running ...
2022/03/27 11:18:10 Job still running ...
2022/03/27 11:18:40 Job still running ...
2022/03/27 11:19:10 Job still running ...
2022/03/27 11:19:40 Job still running ...
2022/03/27 11:20:10 Failed to execute job: job 2022-03-27_04_14_39-13703950372204846708 failed
panic: Failed to execute job: job 2022-03-27_04_14_39-13703950372204846708 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc0000480c0, 0x103ebdf, 0x19, 0xc0003f9df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/pwmpguy6tdjlq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #459

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/459/display/redirect?page=changes>

Changes:

[ryanthompson591] iterable_input_value_types will now be an iterable, I don't anticipate

[marco.robles] [BEAM-8218] PulsarIO Connector

[benjamin.gonzalez] [BEAM-12572] Change examples jobs to run as cron jobs

[benjamin.gonzalez] [BEAM-12572] SpotlessApply

[Robert Bradshaw] [BEAM-14171] More explicit asserts in CoGBKResult.

[Robert Bradshaw] Add some comments.

[noreply] [BEAM-14160] Parse filesToStage in Java expansion service (#17167)

[chamikaramj] Mapped JOB_STATE_RESOURCE_CLEANING_UP to RESOURCE_CLEANING_UP in Python

[noreply] Explicitly import estimator from tensorflow (#17168)


------------------------------------------
[...truncated 17.14 KB...]
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648293281894532867/****\022@9afffb8e4cef1a61d8ae14a2d67fa4de813a832694f1bcd15c0b504536f513f8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/26 11:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648293281894532867/model
2022/03/26 11:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0326100408"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648293281894532867/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648293281894532867/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0326100408",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/26 11:14:43 Submitted job: 2022-03-26_04_14_42-16471892926214988651
2022/03/26 11:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-26_04_14_42-16471892926214988651?project=apache-beam-testing
2022/03/26 11:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-26_04_14_42-16471892926214988651
2022/03/26 11:14:43 Job state: JOB_STATE_PENDING ...
2022/03/26 11:15:13 Job still running ...
2022/03/26 11:15:43 Job still running ...
2022/03/26 11:16:13 Job still running ...
2022/03/26 11:16:43 Job still running ...
2022/03/26 11:17:13 Job still running ...
2022/03/26 11:17:43 Job still running ...
2022/03/26 11:18:13 Job still running ...
2022/03/26 11:18:43 Job still running ...
2022/03/26 11:19:13 Job still running ...
2022/03/26 11:19:43 Failed to execute job: job 2022-03-26_04_14_42-16471892926214988651 failed
panic: Failed to execute job: job 2022-03-26_04_14_42-16471892926214988651 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc000120000, 0x103ebdf, 0x19, 0xc0003d1df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 20s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bybjxlctvba6a

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #458

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/458/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-14139] Drop support for Flink 1.11.

[Kyle Weaver] [BEAM-14139] Remove obsolete reference to Flink 1.11.

[Kyle Weaver] [BEAM-14139] Update list of supported Flink versions.

[Kyle Weaver] [BEAM-14139] Update CHANGES.md

[noreply] [BEAM-14157] Don't call requestObserver.onNext on a closed windmill

[noreply] Minor: Make IOTypeHints a real NamedTuple (#17174)

[noreply] [BEAM-14172] Update tox.ini for pydocs (#17176)

[noreply] [BEAM-14065] Upgrade vendored bytebuddy to version 1.12.8 (#17028)


------------------------------------------
[...truncated 17.15 KB...]
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648206880987396690/****\022@9afffb8e4cef1a61d8ae14a2d67fa4de813a832694f1bcd15c0b504536f513f8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/25 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648206880987396690/model
2022/03/25 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0325100407"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648206880987396690/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648206880987396690/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0325100407",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/25 11:14:42 Submitted job: 2022-03-25_04_14_41-605588238409248467
2022/03/25 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-25_04_14_41-605588238409248467?project=apache-beam-testing
2022/03/25 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-25_04_14_41-605588238409248467
2022/03/25 11:14:42 Job state: JOB_STATE_PENDING ...
2022/03/25 11:15:12 Job still running ...
2022/03/25 11:15:42 Job still running ...
2022/03/25 11:16:12 Job still running ...
2022/03/25 11:16:42 Job still running ...
2022/03/25 11:17:12 Job still running ...
2022/03/25 11:17:42 Job still running ...
2022/03/25 11:18:12 Job still running ...
2022/03/25 11:18:42 Job still running ...
2022/03/25 11:19:12 Job still running ...
2022/03/25 11:19:42 Job still running ...
2022/03/25 11:20:12 Job still running ...
2022/03/25 11:20:42 Failed to execute job: job 2022-03-25_04_14_41-605588238409248467 failed
panic: Failed to execute job: job 2022-03-25_04_14_41-605588238409248467 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc000120000, 0x103ebdf, 0x19, 0xc000387df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 19s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/o6plyk34t75gy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #457

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/457/display/redirect?page=changes>

Changes:

[bulat.safiullin] [BEAM-13976] [Website] update homepage

[bulat.safiullin] [BEAM-13976] [Website] update homepage, add logo

[bulat.safiullin] [BEAM-13976] [Website] update text

[bulat.safiullin] [BEAM-13976] [Website] Update Community landing page

[bulat.safiullin] [BEAM-13979] [Website] Update Community/Contact us page

[bulat.safiullin] [BEAM-13979] [Website] update title

[bulat.safiullin] [BEAM-13979] [Website] delete space

[bulat.safiullin] [BEAM-13979] [Website] add Beam Playground

[bulat.safiullin] [BEAM-13976] [Website] delete Beam Playground

[bulat.safiullin] [BEAM-13976] [Website] change navbar css links rules, delete links from

[bulat.safiullin] [BEAM-13977] [Website] delete available-contact-channels on mobile

[bulat.safiullin] [BEAM-13976] [Website] change padding size between the sections

[bulat.safiullin] [BEAM-13976] [Website] change title to capital letters

[bulat.safiullin] [BEAM-13976] [Website] change title

[bulat.safiullin] [BEAM-14040] [Website] create new page, add link

[bulat.safiullin] [BEAM-13977] [Website] change title

[bulat.safiullin] [BEAM-13979] [Website] change text

[bulat.safiullin] [BEAM-13976] [Website] change text

[bulat.safiullin] [BEAM-13977] [Website] change text, add capital letters

[bulat.safiullin] [BEAM-13976] [Website] add playground sass, change text-align

[bulat.safiullin] [BEAM-14040] [Website] add io connectors table

[bulat.safiullin] [BEAM-13976] [Website] add playground section, add empty line

[bulat.safiullin] [BEAM-14040] [Website] add overflow to css, add table content

[bulat.safiullin] [BEAM-14040] [Website] change ✘ for ✔, add license, add br

[bulat.safiullin] [BEAM-14040] [Website] add empty line

[bulat.safiullin] [BEAM-14040] [Website] change td

[bulat.safiullin] [BEAM-14041] [Website] update built io transforms

[bulat.safiullin] [BEAM-14041] [Website] move connectors from Miscellaneous to Database

[bulat.safiullin] [BEAM-14040] [Website] change links color

[danielamartinmtz] Updated metrics' CronJob API to use the latest batch version.

[bulat.safiullin] [BEAM-14041] [Website] change IO from go to java

[bulat.safiullin] [BEAM-14040] [Website] change links, change specific version to current

[danielamartinmtz] Updated cluster to test in metrics-upgrade-clone in BeamMetrics_Publish

[aydar.zaynutdinov] [BEAM-13976][Website]

[aydar.zaynutdinov] [BEAM-14040][Website]

[aydar.zaynutdinov] [BEAM-14041][Website]

[danielamartinmtz] Updated StateFulSet k8s obejct in cassandra-svc-statefulset.yaml file in

[danielamartinmtz] Updated documentation including cluster specs.

[noreply] Beam 13058 k8s apis upgrade - elasticsearch (#18)

[danielamartinmtz] Removed code used for testing.

[danielamartinmtz] Removed code used for testing in job_PostCommit_BeamMetrics_Publish

[noreply] Beam 13058 k8s apis upgrade - Adding Basic Auth details in documentation

[Pablo Estrada] [BEAM-14151] Excluding Spanner CDC tests from Dataflow V1 suite

[danielamartinmtz] Added comments in initContainers and remove unused code in elasticsearch

[noreply] [BEAM-14134] Optimize memory allocations for various core coders

[noreply] [BEAM-14129] Restructure PubsubLiteIO Read side to produce smaller

[noreply] [BEAM-12697] Add primitive field generation from IR to SBE extension

[noreply] [BEAM-13889] Add test cases to jsonx package (#17124)

[noreply] Remove unreachable code in container.go (#17166)

[noreply] Add ability to handle streaming input to AvroSchemaIOProvider (#17126)

[noreply] [BEAM-12898] Flink Load Tests failure- UncheckedExecutionException -

[Daniel Oliveira] Moving to 2.39.0-SNAPSHOT on master branch.


------------------------------------------
[...truncated 17.09 KB...]
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.39.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648120485527101058/****\022@9afffb8e4cef1a61d8ae14a2d67fa4de813a832694f1bcd15c0b504536f513f8"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/24 11:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648120485527101058/model
2022/03/24 11:14:46 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0324100417"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.39.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648120485527101058/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.39.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648120485527101058/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.39.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.39.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0324100417",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/24 11:14:46 Submitted job: 2022-03-24_04_14_46-10513289599616924720
2022/03/24 11:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-24_04_14_46-10513289599616924720?project=apache-beam-testing
2022/03/24 11:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-24_04_14_46-10513289599616924720
2022/03/24 11:14:46 Job state: JOB_STATE_PENDING ...
2022/03/24 11:15:16 Job still running ...
2022/03/24 11:15:46 Job still running ...
2022/03/24 11:16:16 Job still running ...
2022/03/24 11:16:46 Job still running ...
2022/03/24 11:17:16 Job still running ...
2022/03/24 11:17:46 Job still running ...
2022/03/24 11:18:17 Job still running ...
2022/03/24 11:18:47 Job still running ...
2022/03/24 11:19:17 Job still running ...
2022/03/24 11:19:47 Job still running ...
2022/03/24 11:20:17 Failed to execute job: job 2022-03-24_04_14_46-10513289599616924720 failed
panic: Failed to execute job: job 2022-03-24_04_14_46-10513289599616924720 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc0000480c0, 0x103ebdf, 0x19, 0xc00040ddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gkgjtnfybaoew

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #456

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/456/display/redirect?page=changes>

Changes:

[mmack] [BEAM-13232] Close clients properly in KinesisSource. Also use lazy init

[noreply] [BEAM-14141] Set Interactive Beam to use the default Dataproc image

[noreply] BEAM-14115 - Update find criteria limited to _id (#17102)

[chamikaramj] Disable BigQueryIOStorageWriteIT for general Java post-commit

[noreply] Revert "[BEAM-14038] Auto-startup for Python expansion service.

[noreply] Minor: Bump timeout for Java PreCommit (#17157)

[noreply] [BEAM-14152] Disable flaky

[noreply] Fixing a small bug in TypedSchemaTransformTest that caused it to flake.

[noreply] [BEAM-14116] Catch MonitoringInfoMetricName null keys or values in the

[noreply] [BEAM-14129] Restructure SubscriptionPartitionLoader to use a manual SDF

[noreply] [BEAM-13015] Avoid repeated weighing of StateKey in

[noreply] Add option to add modules to JDK add-open (#17110)

[noreply] [BEAM-13015] Clarify ownership of the list for state caching across


------------------------------------------
[...truncated 17.01 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1648034090544161556/****\022@e3553e35186649bb75f431c6dc8fe86e9a95abe3bd3827814d0d47415c8e360d"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/23 11:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1648034090544161556/model
2022/03/23 11:14:51 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0323100417"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648034090544161556/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1648034090544161556/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0323100417",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/23 11:14:51 Submitted job: 2022-03-23_04_14_51-8931825313930474106
2022/03/23 11:14:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-23_04_14_51-8931825313930474106?project=apache-beam-testing
2022/03/23 11:14:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-23_04_14_51-8931825313930474106
2022/03/23 11:14:51 Job state: JOB_STATE_PENDING ...
2022/03/23 11:15:21 Job still running ...
2022/03/23 11:15:51 Job still running ...
2022/03/23 11:16:22 Job still running ...
2022/03/23 11:16:52 Job still running ...
2022/03/23 11:17:22 Job still running ...
2022/03/23 11:17:52 Job still running ...
2022/03/23 11:18:22 Failed to execute job: job 2022-03-23_04_14_51-8931825313930474106 failed
panic: Failed to execute job: job 2022-03-23_04_14_51-8931825313930474106 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc0000480c0, 0x103ebdf, 0x19, 0xc0002d7df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vtc3pgjorc24g

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #455

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/455/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-14124] Add display data to BQ storage reads.

[mmack] [adhoc] Move aws IT tests to testing package according to best practices

[noreply] fixes static checks and go lint issues (#17138)

[Kyle Weaver] Don't print in task configuration.

[noreply] [BEAM-14136] Clean up staticcheck and linter warnings in the Go SDK

[noreply] Merge pull request #17063 from [BEAM-12164] Fix flaky tests

[noreply] Revert "[BEAM-14112] Avoid storing a generator in _CustomBigQuerySource

[Kyle Weaver] [BEAM-4106] Remove filesToStage from Flink pipeline option list.

[noreply] [BEAM-14071] Enabling Flink on Dataproc for Interactive Beam (#17044)

[noreply] Minor: Bypass schema registry in schemas_test.py (#17108)


------------------------------------------
[...truncated 17.10 KB...]
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647947673395833609/****\022@e3553e35186649bb75f431c6dc8fe86e9a95abe3bd3827814d0d47415c8e360d"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/22 11:14:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647947673395833609/model
2022/03/22 11:14:34 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0322100357"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647947673395833609/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647947673395833609/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0322100357",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/22 11:14:34 Submitted job: 2022-03-22_04_14_34-15726452692935567941
2022/03/22 11:14:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-22_04_14_34-15726452692935567941?project=apache-beam-testing
2022/03/22 11:14:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-22_04_14_34-15726452692935567941
2022/03/22 11:14:34 Job state: JOB_STATE_PENDING ...
2022/03/22 11:15:04 Job still running ...
2022/03/22 11:15:34 Job still running ...
2022/03/22 11:16:04 Job still running ...
2022/03/22 11:16:34 Job still running ...
2022/03/22 11:17:05 Job still running ...
2022/03/22 11:17:35 Job still running ...
2022/03/22 11:18:05 Job still running ...
2022/03/22 11:18:35 Job still running ...
2022/03/22 11:19:05 Job still running ...
2022/03/22 11:19:35 Job still running ...
2022/03/22 11:20:05 Failed to execute job: job 2022-03-22_04_14_34-15726452692935567941 failed
panic: Failed to execute job: job 2022-03-22_04_14_34-15726452692935567941 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc000120000, 0x103ebdf, 0x19, 0xc000403df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 42s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rhrzikysa3zpw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #454

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/454/display/redirect>

Changes:


------------------------------------------
[...truncated 17.11 KB...]
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647861283640094372/****\022@067adcfa7ebda1611eb2e98b8229be2f3a8b5d0763f2bbb323487cafa77c9095"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/21 11:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647861283640094372/model
2022/03/21 11:14:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0321100413"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647861283640094372/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647861283640094372/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0321100413",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/21 11:14:44 Submitted job: 2022-03-21_04_14_44-13845994956937437061
2022/03/21 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-21_04_14_44-13845994956937437061?project=apache-beam-testing
2022/03/21 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-21_04_14_44-13845994956937437061
2022/03/21 11:14:44 Job state: JOB_STATE_PENDING ...
2022/03/21 11:15:14 Job state: JOB_STATE_PENDING ...
2022/03/21 11:15:44 Job state: JOB_STATE_PENDING ...
2022/03/21 11:16:14 Job still running ...
2022/03/21 11:16:45 Job still running ...
2022/03/21 11:17:15 Job still running ...
2022/03/21 11:17:45 Job still running ...
2022/03/21 11:18:15 Job still running ...
2022/03/21 11:18:45 Job still running ...
2022/03/21 11:19:15 Job still running ...
2022/03/21 11:19:45 Failed to execute job: job 2022-03-21_04_14_44-13845994956937437061 failed
panic: Failed to execute job: job 2022-03-21_04_14_44-13845994956937437061 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc000120000, 0x103ebdf, 0x19, 0xc0002a9df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 24s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ukjeuerwa5iw4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #453

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/453/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14122] Upgrade pip-licenses dependency (#17132)


------------------------------------------
[...truncated 17.05 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647774879952395304/****\022@067adcfa7ebda1611eb2e98b8229be2f3a8b5d0763f2bbb323487cafa77c9095"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/20 11:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647774879952395304/model
2022/03/20 11:14:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0320100354"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647774879952395304/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647774879952395304/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0320100354",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/20 11:14:41 Submitted job: 2022-03-20_04_14_40-8681839246623311681
2022/03/20 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-20_04_14_40-8681839246623311681?project=apache-beam-testing
2022/03/20 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-20_04_14_40-8681839246623311681
2022/03/20 11:14:41 Job state: JOB_STATE_PENDING ...
2022/03/20 11:15:11 Job still running ...
2022/03/20 11:15:41 Job still running ...
2022/03/20 11:16:11 Job still running ...
2022/03/20 11:16:41 Job still running ...
2022/03/20 11:17:11 Job still running ...
2022/03/20 11:17:41 Job still running ...
2022/03/20 11:18:11 Failed to execute job: job 2022-03-20_04_14_40-8681839246623311681 failed
panic: Failed to execute job: job 2022-03-20_04_14_40-8681839246623311681 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc000120000, 0x103ebdf, 0x19, 0xc0003b5df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7t7cudj43khhy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #452

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/452/display/redirect?page=changes>

Changes:

[Kiley Sok] Add Java 17 Nexmark metrics to Grafana

[yiru] .

[yiru] .

[yiru] .

[yiru] format fix

[yiru] .

[yiru] make DoFn into a separate class

[yiru] .

[yiru] fix setting

[mmack] [adhoc] Minor cleanup for aws2 tests

[mmack] [BEAM-14125] Update website IO matrix to recommend aws2 IOs

[noreply] [BEAM-14128] Eliminating quadratic behavior of

[noreply] [BEAM-13972] Add RunInference interface (#16917)

[noreply] Merge pull request #17116 from [BEAM-12164] Remove change_stream in

[yiru] fix checkstyle

[yiru] spotlessapply

[noreply] Deprecate tags.go (#17025)

[noreply] [BEAM-12753] and [BEAM-12815] Fix Flink Integration Tests (#17067)

[noreply] Merge pull request #16895 from [BEAM-13882][Playground] More tests for

[noreply] [BEAM-13925] Add weekly automation to update our reviewer config

[noreply] Merge pull request #17076 from Beam 14082 update payground for mobile

[noreply] [BEAM-13925] Assign committers in the scheduled action (#17062)

[noreply] Pin setup-gcloud to v0 instead of master (#17123)

[noreply] [BEAM-3304] documentation for PaneInfo in BPG (#17047)

[noreply] Merge pull request #17016 from [BEAM-14049][Playground] Add new API

[noreply] Merge pull request #17077 from [BEAM-14078] [Website] change link

[noreply] Merge pull request #17085 from [BEAM-14077] [Website] add beam

[noreply] Update Changes.md w/Go pipeline pre-process fix.

[noreply] [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088)

[noreply] Merge pull request #17023 from [BEAM-12164]: Remove child partition


------------------------------------------
[...truncated 17.10 KB...]
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647688481093116634/****\022@067adcfa7ebda1611eb2e98b8229be2f3a8b5d0763f2bbb323487cafa77c9095"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/19 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647688481093116634/model
2022/03/19 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0319100410"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647688481093116634/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647688481093116634/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0319100410",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/19 11:14:42 Submitted job: 2022-03-19_04_14_41-276658576981922513
2022/03/19 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-19_04_14_41-276658576981922513?project=apache-beam-testing
2022/03/19 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-19_04_14_41-276658576981922513
2022/03/19 11:14:42 Job state: JOB_STATE_PENDING ...
2022/03/19 11:15:12 Job still running ...
2022/03/19 11:15:42 Job still running ...
2022/03/19 11:16:12 Job still running ...
2022/03/19 11:16:42 Job still running ...
2022/03/19 11:17:12 Job still running ...
2022/03/19 11:17:42 Job still running ...
2022/03/19 11:18:12 Job still running ...
2022/03/19 11:18:42 Job still running ...
2022/03/19 11:19:12 Job still running ...
2022/03/19 11:19:42 Job still running ...
2022/03/19 11:20:13 Failed to execute job: job 2022-03-19_04_14_41-276658576981922513 failed
panic: Failed to execute job: job 2022-03-19_04_14_41-276658576981922513 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc0000480c0, 0x103ebdf, 0x19, 0xc0004b5df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/soyx34kzzvtxc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #451

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/451/display/redirect?page=changes>

Changes:

[Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage.

[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner

[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)

[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,

[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.

[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource (#17100)

[noreply] Populate environment capabilities in v1beta3 protos. (#17042)

[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in BQ IO.

[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on Dataflow,

[noreply] [BEAM-14038] Auto-startup for Python expansion service. (#17035)

[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.

[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)

[noreply] Merge pull request #16977 from [BEAM-12164]  Added integration test for


------------------------------------------
[...truncated 17.21 KB...]
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647602087525413565/****\022@5c3d05aaaeba11707a4ae196a4e435ba4e8de26853d6b3bc8e2b210c2345f9ed"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/18 11:14:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647602087525413565/model
2022/03/18 11:14:48 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0318100405"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647602087525413565/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647602087525413565/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0318100405",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/18 11:14:48 Submitted job: 2022-03-18_04_14_48-3265043485622762530
2022/03/18 11:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-18_04_14_48-3265043485622762530?project=apache-beam-testing
2022/03/18 11:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-18_04_14_48-3265043485622762530
2022/03/18 11:14:48 Job state: JOB_STATE_PENDING ...
2022/03/18 11:15:18 Job still running ...
2022/03/18 11:15:48 Job still running ...
2022/03/18 11:16:18 Job still running ...
2022/03/18 11:16:48 Job still running ...
2022/03/18 11:17:18 Job still running ...
2022/03/18 11:17:49 Job still running ...
2022/03/18 11:18:19 Job still running ...
2022/03/18 11:18:49 Job still running ...
2022/03/18 11:19:19 Job still running ...
2022/03/18 11:19:49 Job still running ...
2022/03/18 11:20:19 Job still running ...
2022/03/18 11:20:49 Failed to execute job: job 2022-03-18_04_14_48-3265043485622762530 failed
panic: Failed to execute job: job 2022-03-18_04_14_48-3265043485622762530 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151708, 0xc000120000, 0x103ebdf, 0x19, 0xc0003efdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 6m 26s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rvzl552twnpgu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #450

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/450/display/redirect?page=changes>

Changes:

[noreply] Mapped JOB_STATE_RESOURCE_CLEANING_UP to State.RUNNING.

[ryanthompson591] fixed typo in typehints

[zyichi] Remove unused prebuild_sdk_container_base_iamge option from validate

[hengfeng] feat: add more custom metrics

[noreply] [BEAM-14103][Playgrounf][Bugfix] Fix google analytics id (#17092)

[noreply] Minor: Make ScopedReadStateSupplier final (#16992)

[noreply] [BEAM-14113] Improve SamzaJobServerDriver extensibility (#17099)

[noreply] [BEAM-14116] Chunk commit requests dynamically (#17004)

[noreply] Merge pull request #17079 from [BEAM-13660] Add types and queries in

[noreply] [BEAM-13888] Add unit testing to ioutilx (#17058)

[noreply] Merge pull request #16822 from [BEAM-13841][Playground] Add Application

[noreply] Minor: Make serializableCoder warning gramatically correct english

[noreply] [BEAM-14091] Fixing Interactive Beam show/collect for remote runners


------------------------------------------
[...truncated 17.09 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647515684688075973/****\022@fb2f89ef102436d8d666259d8c1b3c06ef63c1fb54d410a69ea070b116c1cb60"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/17 11:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647515684688075973/model
2022/03/17 11:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0317100404"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647515684688075973/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647515684688075973/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0317100404",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/17 11:14:45 Submitted job: 2022-03-17_04_14_45-10567817975904733184
2022/03/17 11:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-17_04_14_45-10567817975904733184?project=apache-beam-testing
2022/03/17 11:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-17_04_14_45-10567817975904733184
2022/03/17 11:14:46 Job state: JOB_STATE_PENDING ...
2022/03/17 11:15:16 Job still running ...
2022/03/17 11:15:46 Job still running ...
2022/03/17 11:16:16 Job still running ...
2022/03/17 11:16:46 Job still running ...
2022/03/17 11:17:16 Job still running ...
2022/03/17 11:17:46 Job still running ...
2022/03/17 11:18:16 Failed to execute job: job 2022-03-17_04_14_45-10567817975904733184 failed
panic: Failed to execute job: job 2022-03-17_04_14_45-10567817975904733184 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151648, 0xc0000480c0, 0x103eb1f, 0x19, 0xc000409df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jrbgwyg3uhfv6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #449

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/449/display/redirect?page=changes>

Changes:

[Chamikara Madhusanka Jayalath] Updates x-lang release validation to use staged jars

[dhuntsperger] documented maven-to-gradle conversion for Dataflow; refactored java

[dhuntsperger] adding a list of example pipelines

[dhuntsperger] removing unnecessary `ls` command from maven project generation

[dhuntsperger] fixing filename formatting in response to feedback

[dhuntsperger] adding extra step emphasizing runner setupt

[dhuntsperger] reorganized instructions to emphasize setup steps for runners

[noreply] [BEAM-13767] Move a bunch of python tasks to use gradle configuration…

[noreply] Merge pull request #17052 from [BEAM-13818] [SnowflakeIO] Add support

[noreply] Adding pydoc for StateHandler (#17091)

[noreply] BEAM-3165 Bypass split if numSplit is zero (#17084)


------------------------------------------
[...truncated 17.16 KB...]
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647429279272554108/****\022@fb2f89ef102436d8d666259d8c1b3c06ef63c1fb54d410a69ea070b116c1cb60"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/16 11:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647429279272554108/model
2022/03/16 11:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0316100411"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647429279272554108/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647429279272554108/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0316100411",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/16 11:14:40 Submitted job: 2022-03-16_04_14_39-12179253025786594909
2022/03/16 11:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-16_04_14_39-12179253025786594909?project=apache-beam-testing
2022/03/16 11:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-16_04_14_39-12179253025786594909
2022/03/16 11:14:40 Job state: JOB_STATE_PENDING ...
2022/03/16 11:15:10 Job still running ...
2022/03/16 11:15:40 Job still running ...
2022/03/16 11:16:10 Job still running ...
2022/03/16 11:16:40 Job still running ...
2022/03/16 11:17:10 Job still running ...
2022/03/16 11:17:40 Job still running ...
2022/03/16 11:18:10 Job still running ...
2022/03/16 11:18:40 Job still running ...
2022/03/16 11:19:11 Job still running ...
2022/03/16 11:19:41 Job still running ...
2022/03/16 11:20:11 Failed to execute job: job 2022-03-16_04_14_39-12179253025786594909 failed
panic: Failed to execute job: job 2022-03-16_04_14_39-12179253025786594909 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151648, 0xc000120000, 0x103eb1f, 0x19, 0xc0003ffdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ul7tyhxlaecb4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #448

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/448/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test

[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test

[benjamin.gonzalez] [BEAM-12572] Add java examples tests

[benjamin.gonzalez] [BEAM-12572] Change tests collected by runner

[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions, skip tests for specific runners

[benjamin.gonzalez] [BEAM-12572] Skip failing tests

[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warnings

[benjamin.gonzalez] [BEAM-12572] Skip tfidf tests on direct runner

[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions

[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warning

[benjamin.gonzalez] [BEAM-12572] Enable test with Pipeline serialization error fixed, link

[benjamin.gonzalez] [BEAM-12572] Sickbay TfIdf test for DirectRunner

[benjamin.gonzalez] [BEAM-12572] Refactor naming for BigQueryClient

[mmack] [BEAM-13175] Add KinesisIO.write for AWS SDK v2.

[mmack] [adhoc] Update owners for aws modules

[noreply] [BEAM-14051] Add a warning to gradle.properties that many Beam modules

[noreply] Merge pull request #17000 from [BEAM-13881] [Playground] Increase test

[noreply] Add deterministic dict coding via key sorting. (#17037)

[noreply] Merge pull request #17054 from [BEAM-14075] [SnowflakeIO] Change a

[mmack] [BEAM-13175] Document changes to IOs in amazon-web-services2 for AWS


------------------------------------------
[...truncated 17.11 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647342881690944413/****\022@fb2f89ef102436d8d666259d8c1b3c06ef63c1fb54d410a69ea070b116c1cb60"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/15 11:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647342881690944413/model
2022/03/15 11:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0315100413"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647342881690944413/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647342881690944413/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0315100413",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/15 11:14:42 Submitted job: 2022-03-15_04_14_42-16153982339802797847
2022/03/15 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-15_04_14_42-16153982339802797847?project=apache-beam-testing
2022/03/15 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-15_04_14_42-16153982339802797847
2022/03/15 11:14:42 Job state: JOB_STATE_PENDING ...
2022/03/15 11:15:13 Job still running ...
2022/03/15 11:15:43 Job still running ...
2022/03/15 11:16:13 Job still running ...
2022/03/15 11:16:43 Job still running ...
2022/03/15 11:17:13 Job still running ...
2022/03/15 11:17:43 Job still running ...
2022/03/15 11:18:13 Job still running ...
2022/03/15 11:18:43 Failed to execute job: job 2022-03-15_04_14_42-16153982339802797847 failed
panic: Failed to execute job: job 2022-03-15_04_14_42-16153982339802797847 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151648, 0xc0000480c0, 0x103eb1f, 0x19, 0xc0003d3df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 21s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/nblzrk7pomhmc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #447

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/447/display/redirect>

Changes:


------------------------------------------
[...truncated 17.11 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647256504001756444/****\022@fb2f89ef102436d8d666259d8c1b3c06ef63c1fb54d410a69ea070b116c1cb60"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/14 11:15:04 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647256504001756444/model
2022/03/14 11:15:04 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0314100351"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647256504001756444/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647256504001756444/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0314100351",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/14 11:15:05 Submitted job: 2022-03-14_04_15_04-16218389805394601283
2022/03/14 11:15:05 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-14_04_15_04-16218389805394601283?project=apache-beam-testing
2022/03/14 11:15:05 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-14_04_15_04-16218389805394601283
2022/03/14 11:15:05 Job state: JOB_STATE_PENDING ...
2022/03/14 11:15:35 Job still running ...
2022/03/14 11:16:05 Job still running ...
2022/03/14 11:16:35 Job still running ...
2022/03/14 11:17:05 Job still running ...
2022/03/14 11:17:35 Job still running ...
2022/03/14 11:18:05 Job still running ...
2022/03/14 11:18:35 Failed to execute job: job 2022-03-14_04_15_04-16218389805394601283 failed
panic: Failed to execute job: job 2022-03-14_04_15_04-16218389805394601283 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151648, 0xc0000480c0, 0x103eb1f, 0x19, 0xc000401df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rvxq6qrkd5xtw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #446

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/446/display/redirect?page=changes>

Changes:

[noreply] [BEAM-14072] [BEAM-13993] [BEAM-10039] Import beam plugins before


------------------------------------------
[...truncated 17.03 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647170071863238165/****\022@fb2f89ef102436d8d666259d8c1b3c06ef63c1fb54d410a69ea070b116c1cb60"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/13 11:14:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647170071863238165/model
2022/03/13 11:14:32 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0313100404"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647170071863238165/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647170071863238165/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0313100404",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/13 11:14:33 Submitted job: 2022-03-13_04_14_32-6518470218056206818
2022/03/13 11:14:33 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-13_04_14_32-6518470218056206818?project=apache-beam-testing
2022/03/13 11:14:33 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-13_04_14_32-6518470218056206818
2022/03/13 11:14:33 Job state: JOB_STATE_PENDING ...
2022/03/13 11:15:03 Job still running ...
2022/03/13 11:15:33 Job still running ...
2022/03/13 11:16:03 Job still running ...
2022/03/13 11:16:33 Job still running ...
2022/03/13 11:17:03 Job still running ...
2022/03/13 11:17:33 Job still running ...
2022/03/13 11:18:03 Failed to execute job: job 2022-03-13_04_14_32-6518470218056206818 failed
panic: Failed to execute job: job 2022-03-13_04_14_32-6518470218056206818 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151648, 0xc0000480c0, 0x103eb1f, 0x19, 0xc00041fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 41s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/qrb4zffywvsno

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #445

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/445/display/redirect?page=changes>

Changes:

[Ismaël Mejía] [BEAM-13981] Remove Spark Runner specific code for event logging

[vitaly.terentyev] [BEAM-2766] Support null key/values in HadoopFormatIO

[vitaly.terentyev] [BEAM-2766] Fix checkstyle


------------------------------------------
[...truncated 17.07 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1647083680855344424/****\022@fb2f89ef102436d8d666259d8c1b3c06ef63c1fb54d410a69ea070b116c1cb60"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/12 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1647083680855344424/model
2022/03/12 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0312100349"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647083680855344424/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1647083680855344424/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0312100349",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/12 11:14:42 Submitted job: 2022-03-12_03_14_41-8579373943358986728
2022/03/12 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-12_03_14_41-8579373943358986728?project=apache-beam-testing
2022/03/12 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-12_03_14_41-8579373943358986728
2022/03/12 11:14:42 Job state: JOB_STATE_PENDING ...
2022/03/12 11:15:12 Job still running ...
2022/03/12 11:15:42 Job still running ...
2022/03/12 11:16:12 Job still running ...
2022/03/12 11:16:42 Job still running ...
2022/03/12 11:17:12 Job still running ...
2022/03/12 11:17:42 Job still running ...
2022/03/12 11:18:12 Failed to execute job: job 2022-03-12_03_14_41-8579373943358986728 failed
panic: Failed to execute job: job 2022-03-12_03_14_41-8579373943358986728 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151648, 0xc0000480c0, 0x103eb1f, 0x19, 0xc0002dbdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5m5mycitqavei

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #444

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/444/display/redirect?page=changes>

Changes:

[ihr] [BEAM-13923] Fix the answers placeholders locations in the Java katas

[jakub.kukul] [BEAM-14039] Propagate ignore_unknown_columns parameter.

[stranniknm] [BEAM-14079] playground - improve accessibility

[noreply] [BEAM-13925] Find and address prs that havent been reviewed in a week

[noreply] Fix import path

[noreply] [BEAM-13925] Fix one more import path

[noreply] Add a StatefulDoFn test that sets event time timer within allowed

[noreply] Merge pull request #17056 from [BEAM-14076] [SnowflakeIO] Add support


------------------------------------------
[...truncated 17.08 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646997284817669104/****\022@fb2f89ef102436d8d666259d8c1b3c06ef63c1fb54d410a69ea070b116c1cb60"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/11 11:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646997284817669104/model
2022/03/11 11:14:46 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0311100347"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646997284817669104/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646997284817669104/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0311100347",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/11 11:14:47 Submitted job: 2022-03-11_03_14_46-11314796236493589578
2022/03/11 11:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-11_03_14_46-11314796236493589578?project=apache-beam-testing
2022/03/11 11:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-11_03_14_46-11314796236493589578
2022/03/11 11:14:47 Job state: JOB_STATE_PENDING ...
2022/03/11 11:15:17 Job still running ...
2022/03/11 11:15:47 Job still running ...
2022/03/11 11:16:17 Job still running ...
2022/03/11 11:16:47 Job still running ...
2022/03/11 11:17:17 Job still running ...
2022/03/11 11:17:47 Job still running ...
2022/03/11 11:18:17 Failed to execute job: job 2022-03-11_03_14_46-11314796236493589578 failed
panic: Failed to execute job: job 2022-03-11_03_14_46-11314796236493589578 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151648, 0xc000120000, 0x103eb1f, 0x19, 0xc00044fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fylrcansv5fia

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #443

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/443/display/redirect?page=changes>

Changes:

[hengfeng] [BEAM-12164]: display the metadata table's name on UI

[noreply] Revert "[BEAM-13993] [BEAM-10039] Import beam plugins before starting

[noreply] Merge pull request #17036 from [BEAM-12164] Convert all static instances

[noreply] fix variable reference (#16991)

[noreply] Merge pull request #16844 from [BEAM-12164]: allow for nanosecond

[noreply] [BEAM-13904] Increase unit testing in the reflectx package (#17024)


------------------------------------------
[...truncated 17.17 KB...]
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646910878319000137/****\022@fb2f89ef102436d8d666259d8c1b3c06ef63c1fb54d410a69ea070b116c1cb60"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/10 11:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646910878319000137/model
2022/03/10 11:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0308201419"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646910878319000137/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646910878319000137/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0308201419",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/10 11:14:39 Submitted job: 2022-03-10_03_14_39-9114398416362774189
2022/03/10 11:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-10_03_14_39-9114398416362774189?project=apache-beam-testing
2022/03/10 11:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-10_03_14_39-9114398416362774189
2022/03/10 11:14:39 Job state: JOB_STATE_PENDING ...
2022/03/10 11:15:09 Job still running ...
2022/03/10 11:15:39 Job still running ...
2022/03/10 11:16:09 Job still running ...
2022/03/10 11:16:40 Job still running ...
2022/03/10 11:17:10 Job still running ...
2022/03/10 11:17:40 Job still running ...
2022/03/10 11:18:10 Job still running ...
2022/03/10 11:18:40 Job still running ...
2022/03/10 11:19:10 Job still running ...
2022/03/10 11:19:40 Job still running ...
2022/03/10 11:20:10 Failed to execute job: job 2022-03-10_03_14_39-9114398416362774189 failed
panic: Failed to execute job: job 2022-03-10_03_14_39-9114398416362774189 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151648, 0xc0000480c0, 0x103eb1f, 0x19, 0xc000407df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vqc57hyrrklag

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #442

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/442/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Update dataflow API client.

[Robert Bradshaw] Instructions for updating apitools generated files.

[noreply] Merge pull request #17027: [BEAM-11205] Upgrade GCP Libraries BOM

[noreply] [BEAM-13709] Inconsistent behavior when parsing boolean flags across

[noreply] [BEAM-10976] Bundle finalization: Harness and some exec changes (#16980)

[noreply] Merge pull request #16976 from [BEAM-14010] [Website] Add Playground

[noreply] [BEAM-12447] Upgrade cloud build client and add/cleanup options (#17032)


------------------------------------------
[...truncated 17.07 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646824488231789365/****\022@fb2f89ef102436d8d666259d8c1b3c06ef63c1fb54d410a69ea070b116c1cb60"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/09 11:14:48 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646824488231789365/model
2022/03/09 11:14:48 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0308201419"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646824488231789365/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646824488231789365/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0308201419",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/09 11:14:49 Submitted job: 2022-03-09_03_14_48-978816331083905287
2022/03/09 11:14:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-09_03_14_48-978816331083905287?project=apache-beam-testing
2022/03/09 11:14:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-09_03_14_48-978816331083905287
2022/03/09 11:14:49 Job state: JOB_STATE_PENDING ...
2022/03/09 11:15:19 Job still running ...
2022/03/09 11:15:49 Job still running ...
2022/03/09 11:16:19 Job still running ...
2022/03/09 11:16:49 Job still running ...
2022/03/09 11:17:19 Job still running ...
2022/03/09 11:17:50 Job still running ...
2022/03/09 11:18:20 Failed to execute job: job 2022-03-09_03_14_48-978816331083905287 failed
panic: Failed to execute job: job 2022-03-09_03_14_48-978816331083905287 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1151648, 0xc0000480c0, 0x103eb1f, 0x19, 0xc000539df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 57s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jsxxycspv7l6c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #441

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/441/display/redirect?page=changes>

Changes:

[dannymccormick] [BEAM-11085] Test that windows are correctly observed in DoFns

[jrmccluskey] [BEAM-14050] Update taxi.go example instructions

[noreply] Give pr bot write permissions on pr update

[noreply] Adding a logical type for Schemas using proto serialization. (#16940)

[noreply] BEAM-13765 missing PAssert methods (#16668)

[noreply] [BEAM-13909] improve coverage of Provision package (#17014)


------------------------------------------
[...truncated 17.07 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646738091158988808/****\022@7a08f0079c56da5be9fea1f0573f141c4b70548da88d7dc9ad433cfaf9e48857"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/08 11:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646738091158988808/model
2022/03/08 11:14:51 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0308101236"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646738091158988808/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646738091158988808/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0308101236",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/08 11:14:52 Submitted job: 2022-03-08_03_14_51-10995204946391220220
2022/03/08 11:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-08_03_14_51-10995204946391220220?project=apache-beam-testing
2022/03/08 11:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-08_03_14_51-10995204946391220220
2022/03/08 11:14:52 Job state: JOB_STATE_PENDING ...
2022/03/08 11:15:22 Job still running ...
2022/03/08 11:15:52 Job still running ...
2022/03/08 11:16:22 Job still running ...
2022/03/08 11:16:52 Job still running ...
2022/03/08 11:17:22 Job still running ...
2022/03/08 11:17:52 Job still running ...
2022/03/08 11:18:23 Failed to execute job: job 2022-03-08_03_14_51-10995204946391220220 failed
panic: Failed to execute job: job 2022-03-08_03_14_51-10995204946391220220 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc000120000, 0x103bedf, 0x19, 0xc000423df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/meqqmsy2epows

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #440

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/440/display/redirect?page=changes>

Changes:

[noreply] [BEAM-13925] Add ability to get metrics on pr-bot performance (#16985)


------------------------------------------
[...truncated 17.12 KB...]
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646651681880118700/****\022@7a08f0079c56da5be9fea1f0573f141c4b70548da88d7dc9ad433cfaf9e48857"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/07 11:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646651681880118700/model
2022/03/07 11:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0307101310"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646651681880118700/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646651681880118700/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0307101310",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/07 11:14:42 Submitted job: 2022-03-07_03_14_42-10041463677824980554
2022/03/07 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-07_03_14_42-10041463677824980554?project=apache-beam-testing
2022/03/07 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-07_03_14_42-10041463677824980554
2022/03/07 11:14:43 Job state: JOB_STATE_PENDING ...
2022/03/07 11:15:13 Job still running ...
2022/03/07 11:15:43 Job still running ...
2022/03/07 11:16:13 Job still running ...
2022/03/07 11:16:43 Job still running ...
2022/03/07 11:17:13 Job still running ...
2022/03/07 11:17:43 Job still running ...
2022/03/07 11:18:13 Job still running ...
2022/03/07 11:18:43 Job still running ...
2022/03/07 11:19:13 Job still running ...
2022/03/07 11:19:43 Job still running ...
2022/03/07 11:20:13 Failed to execute job: job 2022-03-07_03_14_42-10041463677824980554 failed
panic: Failed to execute job: job 2022-03-07_03_14_42-10041463677824980554 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc000120000, 0x103bedf, 0x19, 0xc0004d3df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/nqeaxxlrfvds6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #439

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/439/display/redirect>

Changes:


------------------------------------------
[...truncated 17.15 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646579859346182995/****\022@7a08f0079c56da5be9fea1f0573f141c4b70548da88d7dc9ad433cfaf9e48857"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/06 15:17:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646579859346182995/model
2022/03/06 15:17:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0306143750"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646579859346182995/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646579859346182995/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0306143750",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/06 15:17:40 Submitted job: 2022-03-06_07_17_40-14288119320979721275
2022/03/06 15:17:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-06_07_17_40-14288119320979721275?project=apache-beam-testing
2022/03/06 15:17:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-06_07_17_40-14288119320979721275
2022/03/06 15:17:40 Job state: JOB_STATE_PENDING ...
2022/03/06 15:18:10 Job still running ...
2022/03/06 15:18:40 Job still running ...
2022/03/06 15:19:10 Job still running ...
2022/03/06 15:19:40 Job still running ...
2022/03/06 15:20:10 Job still running ...
2022/03/06 15:20:40 Job still running ...
2022/03/06 15:21:11 Failed to execute job: job 2022-03-06_07_17_40-14288119320979721275 failed
panic: Failed to execute job: job 2022-03-06_07_17_40-14288119320979721275 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc00019a000, 0x103bedf, 0x19, 0xc000467df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wnhnev23uiqbq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #438

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/438/display/redirect?page=changes>

Changes:

[rahuliyer573] py: Import beam plugins before starting SdkHarness

[stephen.patel] BEAM-14011 fix s3 filesystem multipart copy

[Valentyn Tymofieiev] Bump numpy bound to include 1.22 and regenerate container deps.

[github-actions] [BEAM-13925] months in date constructor are 0 indexed

[noreply] Merge pull request #16842 from [BEAM-13932][Playground] Container's user

[noreply] Doc updates and blog post for 2.37.0 (#16887)

[noreply] Remove resolved issue in docs + update class path on sample (#17018)

[noreply] [BEAM-14016] Fixed flaky postcommit test (#17009)

[noreply] Remove resolved issue in notebook

[noreply] [BEAM-13947] Add split() and rsplit(), non-deferred column operations on

[noreply] BEAM-14026 - Fixes bug related to Unnesting nested rows in an array


------------------------------------------
[...truncated 17.09 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646478882840499984/****\022@7a08f0079c56da5be9fea1f0573f141c4b70548da88d7dc9ad433cfaf9e48857"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/05 11:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646478882840499984/model
2022/03/05 11:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0305100355"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646478882840499984/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646478882840499984/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0305100355",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/05 11:14:44 Submitted job: 2022-03-05_03_14_43-17915312607582411441
2022/03/05 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-05_03_14_43-17915312607582411441?project=apache-beam-testing
2022/03/05 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-05_03_14_43-17915312607582411441
2022/03/05 11:14:44 Job state: JOB_STATE_PENDING ...
2022/03/05 11:15:14 Job still running ...
2022/03/05 11:15:44 Job still running ...
2022/03/05 11:16:14 Job still running ...
2022/03/05 11:16:44 Job still running ...
2022/03/05 11:17:14 Job still running ...
2022/03/05 11:17:44 Job still running ...
2022/03/05 11:18:14 Failed to execute job: job 2022-03-05_03_14_43-17915312607582411441 failed
panic: Failed to execute job: job 2022-03-05_03_14_43-17915312607582411441 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc000120000, 0x103bedf, 0x19, 0xc0004f7df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mhftdskttltus

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #437

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/437/display/redirect?page=changes>

Changes:

[stranniknm] [BEAM-13999] playground - support vertical orientation for graph

[noreply] [adhoc] Prepare aws2 ClientConfiguration for json serialization and

[noreply] Merge pull request #16879 from [BEAM-12164] Add javadocs to

[noreply] [Cleanup] Update pre-v2 go package references (#17002)

[noreply] [BEAM-13885] Add unit tests to window package (#16971)

[noreply] Merge pull request #16891 from [BEAM-13872] [Playground] Increase test

[noreply] Merge pull request #16912 from [BEAM-13878] [Playground] Increase test

[noreply] Merge pull request #16946 from [BEAM-13873] [Playground] Increase test

[noreply] [BEAM-13951] Update mass_comment.py list of Run commands (#16889)

[noreply] [BEAM-10652] Allow Clustering without Partition in BigQuery (#16578)

[noreply] [BEAM-13857] Add K:V flags for expansion service jars and addresses to


------------------------------------------
[...truncated 17.08 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646392488791549347/****\022@7a08f0079c56da5be9fea1f0573f141c4b70548da88d7dc9ad433cfaf9e48857"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/04 11:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646392488791549347/model
2022/03/04 11:14:49 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0304100407"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646392488791549347/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646392488791549347/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0304100407",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/04 11:14:50 Submitted job: 2022-03-04_03_14_49-7154842488817471983
2022/03/04 11:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-04_03_14_49-7154842488817471983?project=apache-beam-testing
2022/03/04 11:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-04_03_14_49-7154842488817471983
2022/03/04 11:14:50 Job state: JOB_STATE_PENDING ...
2022/03/04 11:15:20 Job still running ...
2022/03/04 11:15:50 Job still running ...
2022/03/04 11:16:20 Job still running ...
2022/03/04 11:16:50 Job still running ...
2022/03/04 11:17:20 Job still running ...
2022/03/04 11:17:50 Job still running ...
2022/03/04 11:18:20 Failed to execute job: job 2022-03-04_03_14_49-7154842488817471983 failed
panic: Failed to execute job: job 2022-03-04_03_14_49-7154842488817471983 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc0000480c0, 0x103bedf, 0x19, 0xc0006f1df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 56s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rftjy7ucy7x54

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #436

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/436/display/redirect?page=changes>

Changes:

[Alexey Romanenko] Bump org.mongodb:mongo-java-driver to 3.12.10

[noreply] [BEAM-13973] Link Dataproc Flink master URLs to the InteractiveRunner

[noreply] [BEAM-13925] Turn pr bot on for go prs (#16984)

[Pablo Estrada] Skipping flaky sad-path tests for Spanner changestreams

[noreply] [BEAM-13964] Bump kotlin to 1.6.x (#16882)

[noreply] Merge pull request #16906: [BEAM-13974] Handle idle Storage Api streams

[noreply] Merge pull request #16562 from [BEAM-13051][D] Enable pylint warnings

[noreply] [BEAM-13925] A couple small pr-bot bug fixes (#16996)

[noreply] [BEAM-14029] Add getter, setter for target maven repo (#16995)

[noreply] [BEAM-13903] Improve coverage of metricsx package (#16994)

[noreply] [BEAM-13892] Improve coverage of avroio package (#16990)


------------------------------------------
[...truncated 17.05 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646306086425925862/****\022@e6ddbd6c62992275b961a463ac5acbabe216edb7e23d058aa6a2ede8b0b2b6ea"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/03 11:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646306086425925862/model
2022/03/03 11:14:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0303100402"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646306086425925862/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646306086425925862/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0303100402",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/03 11:14:47 Submitted job: 2022-03-03_03_14_47-10138188017772344171
2022/03/03 11:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-03_03_14_47-10138188017772344171?project=apache-beam-testing
2022/03/03 11:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-03_03_14_47-10138188017772344171
2022/03/03 11:14:47 Job state: JOB_STATE_PENDING ...
2022/03/03 11:15:17 Job still running ...
2022/03/03 11:15:47 Job still running ...
2022/03/03 11:16:17 Job still running ...
2022/03/03 11:16:48 Job still running ...
2022/03/03 11:17:18 Job still running ...
2022/03/03 11:17:48 Job still running ...
2022/03/03 11:18:18 Failed to execute job: job 2022-03-03_03_14_47-10138188017772344171 failed
panic: Failed to execute job: job 2022-03-03_03_14_47-10138188017772344171 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc000198000, 0x103bedf, 0x19, 0xc000479df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fbcr2vv4jy25e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #435

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/435/display/redirect?page=changes>

Changes:

[egalpin] Use default context output rather than outputWithTimestamp for

[stranniknm] Palo Alto case study - fix link

[rogelio.hernandez] [BEAM-12777] Removed current docs version redirect

[noreply] Merge pull request #16850: [BEAM-11205] Upgrade Libraries BOM

[noreply] Merge pull request #16484 from [BEAM-13633] [Playground] Implement

[noreply] Add 2022 events blog post (#16975)

[noreply] Clean up Go formatter suggestions (#16973)

[noreply] [BEAM-14012] Add go fmt to Github Actions (#16978)

[noreply] [BEAM-13911] Add basic tests to Go direct runner. (#16979)

[noreply] [BEAM-13960] Add support for more types when converting from between row


------------------------------------------
[...truncated 17.13 KB...]
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646219682441722768/****\022@0f95806c7d1b17aae541c6d4f961b482e2d8a23ce7a512b9395571d719b4973c"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/02 11:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646219682441722768/model
2022/03/02 11:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0302100357"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646219682441722768/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646219682441722768/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0302100357",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/02 11:14:44 Submitted job: 2022-03-02_03_14_43-17098037420755764941
2022/03/02 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-02_03_14_43-17098037420755764941?project=apache-beam-testing
2022/03/02 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-02_03_14_43-17098037420755764941
2022/03/02 11:14:44 Job state: JOB_STATE_PENDING ...
2022/03/02 11:15:14 Job still running ...
2022/03/02 11:15:44 Job still running ...
2022/03/02 11:16:14 Job still running ...
2022/03/02 11:16:44 Job still running ...
2022/03/02 11:17:14 Job still running ...
2022/03/02 11:17:44 Job still running ...
2022/03/02 11:18:14 Job still running ...
2022/03/02 11:18:44 Job still running ...
2022/03/02 11:19:14 Job still running ...
2022/03/02 11:19:44 Job still running ...
2022/03/02 11:20:15 Failed to execute job: job 2022-03-02_03_14_43-17098037420755764941 failed
panic: Failed to execute job: job 2022-03-02_03_14_43-17098037420755764941 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e3e8, 0xc000120000, 0x103be9f, 0x19, 0xc0003e3df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/67osnpekitpd6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #434

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/434/display/redirect?page=changes>

Changes:

[noreply] Build wheels for Python 3.9

[noreply] Merge pull request #16892 from [BEAM-13755] [Playground] Scroll the

[noreply] Merge pull request #16880 from [BEAM-13963][Playground] Get bucket name

[noreply] Merge pull request #16870 from [BEAM-13874][Playground] Tag multifile

[noreply] Merge pull request #16910 from [BEAM-13724] [Playground] Get the default

[noreply] [BEAM-14008] Fix incorrect guava import (#16966)

[noreply] Fix ignored exception in BatchSpannerRead. (#16960)

[noreply] [BEAM-13917] Improve coverage of databaseio package (#16956)

[noreply] [BEAM-13925] Add entry files to process new prs and pr updates for PR

[noreply] [BEAM-13899] Improve coverage of debug package (#16951)

[noreply] [BEAM-13907] Improve coverage of textio package (#16937)

[noreply] [BEAM-9150] Fix beam_PostRelease_Python_Candidate (python RC validation


------------------------------------------
[...truncated 17.08 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646133279252255094/****\022@0f95806c7d1b17aae541c6d4f961b482e2d8a23ce7a512b9395571d719b4973c"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/03/01 11:14:40 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646133279252255094/model
2022/03/01 11:14:40 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0301100407"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646133279252255094/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646133279252255094/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0301100407",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/03/01 11:14:41 Submitted job: 2022-03-01_03_14_40-4750079514530950399
2022/03/01 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-03-01_03_14_40-4750079514530950399?project=apache-beam-testing
2022/03/01 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-03-01_03_14_40-4750079514530950399
2022/03/01 11:14:41 Job state: JOB_STATE_PENDING ...
2022/03/01 11:15:11 Job still running ...
2022/03/01 11:15:41 Job still running ...
2022/03/01 11:16:11 Job still running ...
2022/03/01 11:16:41 Job still running ...
2022/03/01 11:17:11 Job still running ...
2022/03/01 11:17:41 Job still running ...
2022/03/01 11:18:11 Failed to execute job: job 2022-03-01_03_14_40-4750079514530950399 failed
panic: Failed to execute job: job 2022-03-01_03_14_40-4750079514530950399 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e3e8, 0xc0000480c0, 0x103be9f, 0x19, 0xc000441df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bhmhm4zgjhhq4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #433

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/433/display/redirect>

Changes:


------------------------------------------
[...truncated 17.15 KB...]
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1646046886133402475/****\022@0f95806c7d1b17aae541c6d4f961b482e2d8a23ce7a512b9395571d719b4973c"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/28 11:14:46 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1646046886133402475/model
2022/02/28 11:14:46 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0228100407"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646046886133402475/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1646046886133402475/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0228100407",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/28 11:14:47 Submitted job: 2022-02-28_03_14_46-426937022151144000
2022/02/28 11:14:47 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-28_03_14_46-426937022151144000?project=apache-beam-testing
2022/02/28 11:14:47 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-28_03_14_46-426937022151144000
2022/02/28 11:14:47 Job state: JOB_STATE_PENDING ...
2022/02/28 11:15:17 Job still running ...
2022/02/28 11:15:47 Job still running ...
2022/02/28 11:16:17 Job still running ...
2022/02/28 11:16:47 Job still running ...
2022/02/28 11:17:17 Job still running ...
2022/02/28 11:17:47 Job still running ...
2022/02/28 11:18:17 Job still running ...
2022/02/28 11:18:47 Job still running ...
2022/02/28 11:19:17 Job still running ...
2022/02/28 11:19:47 Job still running ...
2022/02/28 11:20:17 Failed to execute job: job 2022-02-28_03_14_46-426937022151144000 failed
panic: Failed to execute job: job 2022-02-28_03_14_46-426937022151144000 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e3e8, 0xc000120000, 0x103be9f, 0x19, 0xc0003eddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6lcw767n3h32s

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #432

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/432/display/redirect>

Changes:


------------------------------------------
[...truncated 17.10 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645960478400919322/****\022@0f95806c7d1b17aae541c6d4f961b482e2d8a23ce7a512b9395571d719b4973c"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/27 11:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645960478400919322/model
2022/02/27 11:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0227100403"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645960478400919322/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645960478400919322/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0227100403",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/27 11:14:40 Submitted job: 2022-02-27_03_14_39-5246506461415165811
2022/02/27 11:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-27_03_14_39-5246506461415165811?project=apache-beam-testing
2022/02/27 11:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-27_03_14_39-5246506461415165811
2022/02/27 11:14:40 Job state: JOB_STATE_PENDING ...
2022/02/27 11:15:10 Job still running ...
2022/02/27 11:15:40 Job still running ...
2022/02/27 11:16:10 Job still running ...
2022/02/27 11:16:40 Job still running ...
2022/02/27 11:17:10 Job still running ...
2022/02/27 11:17:40 Job still running ...
2022/02/27 11:18:10 Failed to execute job: job 2022-02-27_03_14_39-5246506461415165811 failed
panic: Failed to execute job: job 2022-02-27_03_14_39-5246506461415165811 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e3e8, 0xc000120000, 0x103be9f, 0x19, 0xc00057ddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mhdtpp3mlzcno

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #431

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/431/display/redirect?page=changes>

Changes:

[Ankur Goenka] [BEAM-13952] Sickbaying

[noreply] Memoize some objects for timer processing to reduce overhead. (#16207)

[noreply] [BEAM-13965] Use TypeDeserializer if type information is available to

[noreply] [BEAM-13912] Add more coverage for dataflow.go (#16903)

[noreply] [BEAM-12563] swaplevel general function for dataframe and series

[noreply] [BEAM-14001] Update coder.go unit tests (#16952)

[noreply] [BEAM-13910] Improve coverage of gcsx package (#16942)

[noreply] [BEAM-13015] Use a DirectExecutor for state since we are just completing


------------------------------------------
[...truncated 17.10 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645874083049891617/****\022@0f95806c7d1b17aae541c6d4f961b482e2d8a23ce7a512b9395571d719b4973c"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/26 11:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645874083049891617/model
2022/02/26 11:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0226100344"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645874083049891617/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645874083049891617/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0226100344",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/26 11:14:44 Submitted job: 2022-02-26_03_14_43-8338418297770581534
2022/02/26 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-26_03_14_43-8338418297770581534?project=apache-beam-testing
2022/02/26 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-26_03_14_43-8338418297770581534
2022/02/26 11:14:44 Job state: JOB_STATE_PENDING ...
2022/02/26 11:15:14 Job still running ...
2022/02/26 11:15:44 Job still running ...
2022/02/26 11:16:14 Job still running ...
2022/02/26 11:16:44 Job still running ...
2022/02/26 11:17:14 Job still running ...
2022/02/26 11:17:44 Job still running ...
2022/02/26 11:18:14 Failed to execute job: job 2022-02-26_03_14_43-8338418297770581534 failed
panic: Failed to execute job: job 2022-02-26_03_14_43-8338418297770581534 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e3e8, 0xc000120000, 0x103be9f, 0x19, 0xc0003fbdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/xi3kxue2a3ylu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #430

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/430/display/redirect?page=changes>

Changes:

[benjamin.gonzalez] Revert PR#16253 due errors with plugin flaky-test-handler

[noreply] Fix BoundedQueueExecutor and StreamingDataflowWorker to actually limit

[noreply] [BEAM-1857] Add Neo4jIO (#15916)

[noreply] [BEAM-13767] Migrate serveral portable runner tasks to use configuration

[noreply] [BEAM-13996] Removing 'No cluster_manager is associated with the

[noreply] [BEAM-13906] Improve coverage of errors package (#16934)

[noreply] [BEAM-13886] unit tests for trigger package (#16935)

[noreply] [BEAM-4767] Remove beam- prefix from release script tags (#16899)

[noreply] [BEAM-13866] Add small unit tests to errorx, make boolean assignment

[noreply] [BEAM-13925] Add most of the supporting files for the pr management

[noreply] Merge pull request #16846 from [BEAM-12164]: Add sad path tests for


------------------------------------------
[...truncated 17.09 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645787683183948870/****\022@c316c87b064dcebbee7e6be5158e747b408ffc48035904a8c4c1f0b0829c015a"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/25 11:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645787683183948870/model
2022/02/25 11:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0225100353"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645787683183948870/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645787683183948870/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0225100353",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/25 11:14:44 Submitted job: 2022-02-25_03_14_43-800947524234582336
2022/02/25 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-25_03_14_43-800947524234582336?project=apache-beam-testing
2022/02/25 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-25_03_14_43-800947524234582336
2022/02/25 11:14:44 Job state: JOB_STATE_PENDING ...
2022/02/25 11:15:14 Job still running ...
2022/02/25 11:15:44 Job still running ...
2022/02/25 11:16:14 Job still running ...
2022/02/25 11:16:44 Job still running ...
2022/02/25 11:17:14 Job still running ...
2022/02/25 11:17:44 Job still running ...
2022/02/25 11:18:14 Failed to execute job: job 2022-02-25_03_14_43-800947524234582336 failed
panic: Failed to execute job: job 2022-02-25_03_14_43-800947524234582336 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc000120000, 0x103be9f, 0x19, 0xc00069fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/qmcxikdgze27k

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #429

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/429/display/redirect?page=changes>

Changes:

[noreply] [BEAM-12645] Fix code-cov flakes due to monorepo. (#16925)

[noreply] [BEAM-13969] Deprecate stringx package (#16884)

[noreply] Add Go badge to ReadMe (#16897)

[noreply] [BEAM-13980] Re-add method gone missing in af2f8ee6 (#16918)

[noreply] [BEAM-13884] Improve mtime package (#16924)

[noreply] Minor: Update Go API doc links (#16932)

[noreply] [BEAM-13218] Re-enable

[noreply] Merge pull request #16857 from [BEAM-13662] [Playground] Support

[noreply] Merge pull request #16826 from [BEAM-13870] [Playground] Increase test


------------------------------------------
[...truncated 17.09 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645701292329825524/****\022@fcf396dcf640ca9ab48c1f74503ed643ba03f0f271df58abf6250bc06966e26a"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/24 11:14:53 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645701292329825524/model
2022/02/24 11:14:53 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0224100400"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645701292329825524/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645701292329825524/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0224100400",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/24 11:14:53 Submitted job: 2022-02-24_03_14_53-4016709542536809324
2022/02/24 11:14:53 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-24_03_14_53-4016709542536809324?project=apache-beam-testing
2022/02/24 11:14:53 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-24_03_14_53-4016709542536809324
2022/02/24 11:14:53 Job state: JOB_STATE_PENDING ...
2022/02/24 11:15:23 Job still running ...
2022/02/24 11:15:53 Job still running ...
2022/02/24 11:16:23 Job still running ...
2022/02/24 11:16:53 Job still running ...
2022/02/24 11:17:23 Job still running ...
2022/02/24 11:17:53 Job still running ...
2022/02/24 11:18:23 Failed to execute job: job 2022-02-24_03_14_53-4016709542536809324 failed
panic: Failed to execute job: job 2022-02-24_03_14_53-4016709542536809324 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc0000480c0, 0x103be9f, 0x19, 0xc0004d7df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/y77dzdg3fp2c6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #428

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/428/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-13796] projection pushdown in BQ IO

[Kyle Weaver] [BEAM-13796] Move test to ReadTest class and correct javadoc for

[Kyle Weaver] [BEAM-13796] Pushdown is not supported on TypedRead#fromQuery.

[noreply] [BEAM-13738] Reenable ignored SQS test after bumping elasticmq for fixed

[noreply] fix build status link (#16907)

[noreply] Merge pull request #16549 from [BEAM-13681][Playground] Refactoring

[noreply] Merge pull request #16732 from [BEAM-13825] [Playground] updated

[noreply] Merge pull request #16683 from [BEAM-13713][Playground] Java graph

[noreply] case study pages - improvements and fixes (#16896)

[noreply] Palo Alto case study (#16915)


------------------------------------------
[...truncated 17.04 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645614876293819012/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/23 11:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645614876293819012/model
2022/02/23 11:14:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0223100411"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645614876293819012/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645614876293819012/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0223100411",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/23 11:14:37 Submitted job: 2022-02-23_03_14_37-13519107217891338682
2022/02/23 11:14:37 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-23_03_14_37-13519107217891338682?project=apache-beam-testing
2022/02/23 11:14:37 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-23_03_14_37-13519107217891338682
2022/02/23 11:14:37 Job state: JOB_STATE_PENDING ...
2022/02/23 11:15:07 Job still running ...
2022/02/23 11:15:37 Job still running ...
2022/02/23 11:16:07 Job still running ...
2022/02/23 11:16:37 Job still running ...
2022/02/23 11:17:07 Job still running ...
2022/02/23 11:17:37 Job still running ...
2022/02/23 11:18:07 Failed to execute job: job 2022-02-23_03_14_37-13519107217891338682 failed
panic: Failed to execute job: job 2022-02-23_03_14_37-13519107217891338682 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc0000480c0, 0x103be9f, 0x19, 0xc000459df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/w2nyvdh5fejs4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #427

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/427/display/redirect>

Changes:


------------------------------------------
[...truncated 17.03 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645528513385911203/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/22 11:15:13 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645528513385911203/model
2022/02/22 11:15:13 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0222101952"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645528513385911203/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645528513385911203/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0222101952",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/22 11:15:14 Submitted job: 2022-02-22_03_15_14-13276679635685599539
2022/02/22 11:15:14 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-22_03_15_14-13276679635685599539?project=apache-beam-testing
2022/02/22 11:15:14 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-22_03_15_14-13276679635685599539
2022/02/22 11:15:14 Job state: JOB_STATE_PENDING ...
2022/02/22 11:15:44 Job still running ...
2022/02/22 11:16:14 Job still running ...
2022/02/22 11:16:44 Job still running ...
2022/02/22 11:17:15 Job still running ...
2022/02/22 11:17:45 Job still running ...
2022/02/22 11:18:15 Job still running ...
2022/02/22 11:18:45 Failed to execute job: job 2022-02-22_03_15_14-13276679635685599539 failed
panic: Failed to execute job: job 2022-02-22_03_15_14-13276679635685599539 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc0000480c0, 0x103be9f, 0x19, 0xc00034bdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/732l6o72qy5cm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #426

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/426/display/redirect>

Changes:


------------------------------------------
[...truncated 17.07 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645467392950545036/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/21 18:16:33 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645467392950545036/model
2022/02/21 18:16:33 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0219185658"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645467392950545036/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645467392950545036/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0219185658",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/21 18:16:34 Submitted job: 2022-02-21_10_16_33-9583865526676088432
2022/02/21 18:16:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-21_10_16_33-9583865526676088432?project=apache-beam-testing
2022/02/21 18:16:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-21_10_16_33-9583865526676088432
2022/02/21 18:16:34 Job state: JOB_STATE_PENDING ...
2022/02/21 18:17:04 Job still running ...
2022/02/21 18:17:34 Job still running ...
2022/02/21 18:18:04 Job still running ...
2022/02/21 18:18:34 Job still running ...
2022/02/21 18:19:04 Job still running ...
2022/02/21 18:19:34 Job still running ...
2022/02/21 18:20:04 Failed to execute job: job 2022-02-21_10_16_33-9583865526676088432 failed
panic: Failed to execute job: job 2022-02-21_10_16_33-9583865526676088432 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc00019a000, 0x103be9f, 0x19, 0xc000273df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/k6qct6flyjjsm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #425

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/425/display/redirect?page=changes>

Changes:

[rogelio.hernandez] [BEAM-13051] Pylint misplaced-bare-raise warning enabled

[rogelio.hernandez] [BEAM-13051] Added descriptions to Kinesis and PortableRunner exceptions

[thiagotnunes] fix: fix bug when retrieving either string or json

[noreply] [BEAM-13812] Integrate DataprocClusterManager into Interactive

[noreply] [BEAM-12572] Fix failing python examples tests in Dataflow runner

[noreply] Remove build status from PR (#16902)


------------------------------------------
[...truncated 17.03 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645269453707609545/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/19 11:17:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645269453707609545/model
2022/02/19 11:17:34 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0219100808"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645269453707609545/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645269453707609545/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0219100808",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/19 11:17:34 Submitted job: 2022-02-19_03_17_34-6881776714559034241
2022/02/19 11:17:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-19_03_17_34-6881776714559034241?project=apache-beam-testing
2022/02/19 11:17:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-19_03_17_34-6881776714559034241
2022/02/19 11:17:34 Job state: JOB_STATE_PENDING ...
2022/02/19 11:18:05 Job still running ...
2022/02/19 11:18:35 Job still running ...
2022/02/19 11:19:05 Job still running ...
2022/02/19 11:19:35 Job still running ...
2022/02/19 11:20:05 Job still running ...
2022/02/19 11:20:35 Job still running ...
2022/02/19 11:21:05 Failed to execute job: job 2022-02-19_03_17_34-6881776714559034241 failed
panic: Failed to execute job: job 2022-02-19_03_17_34-6881776714559034241 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc000120000, 0x103be9f, 0x19, 0xc00026bdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/utdb76xakyzaq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #424

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/424/display/redirect?page=changes>

Changes:

[Pablo Estrada] Simplify README for new users

[Kenneth Knowles] Disable AfterSynchronizedProcessingTime test on Dataflow

[mmack] [BEAM-13563] Introducing common AWS ClientBuilderFactory to unify

[laraschmidt] Fix final allowskew error to properly handle a large allowedSkew

[noreply] Case studies page improvements (#16702)

[noreply] [BEAM-13946] Add get_dummies(), a non-deferred column operation on

[noreply] [release-2.36.0] Fix pickler argument for 2.36 blog (#16774)

[noreply] [adhoc] Avoid using SerializablePipelineOptions for testing to minimize


------------------------------------------
[...truncated 17.03 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645182871681243699/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/18 11:14:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645182871681243699/model
2022/02/18 11:14:32 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0218110533"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645182871681243699/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645182871681243699/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0218110533",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/18 11:14:32 Submitted job: 2022-02-18_03_14_32-669058217247216879
2022/02/18 11:14:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-18_03_14_32-669058217247216879?project=apache-beam-testing
2022/02/18 11:14:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-18_03_14_32-669058217247216879
2022/02/18 11:14:33 Job state: JOB_STATE_PENDING ...
2022/02/18 11:15:03 Job still running ...
2022/02/18 11:15:33 Job still running ...
2022/02/18 11:16:03 Job still running ...
2022/02/18 11:16:33 Job still running ...
2022/02/18 11:17:03 Job still running ...
2022/02/18 11:17:33 Job still running ...
2022/02/18 11:18:03 Failed to execute job: job 2022-02-18_03_14_32-669058217247216879 failed
panic: Failed to execute job: job 2022-02-18_03_14_32-669058217247216879 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc000120000, 0x103be9f, 0x19, 0xc000421df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 42s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/zxkwt3tqxkqvo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #423

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/423/display/redirect?page=changes>

Changes:

[Jeff Tapper] Update Java LTS roadmap info on website for Java 17

[Kyle Weaver] [BEAM-13106] Support Flink 1.14.

[Kyle Weaver] [BEAM-13106] Reuse executor instead of shutting it down mid-test.

[Kyle Weaver] [BEAM-13106] Prevent infinite wait in Flink savepoint test.

[Ismaël Mejía] [BEAM-13202] Fix typos on tests names for VarianceFnTest

[Ismaël Mejía] [BEAM-13202] Add Coder to CountIfFn.Accum

[Ismaël Mejía] [BEAM-13202] Reuse Count transform code since CountIf is a specific case

[Kenneth Knowles] Add test category UsesProcessingTimeTimers

[Kenneth Knowles] Label tests that need UsesProcessingTimeTimers

[Kenneth Knowles] Exclude UsesProcessingTimeTimers from SamzaRunner tests

[Kyle Weaver] [BEAM-13106] A couple additional fixes to FlinkSavepointTest.

[mmack] [adhoc] Migrate KinesisIOIT to use ITEnvironment for Localstack based IT

[noreply] [BEAM-13955] Fix pylint breakage from #16836 (#16867)

[relax] Fix TableRow conversion for the case of fields named "f"

[noreply] Bump dataflow.fnapi_container_version (#16874)


------------------------------------------
[...truncated 17.09 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645096482823062885/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/17 11:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645096482823062885/model
2022/02/17 11:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0217101505"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645096482823062885/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645096482823062885/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0217101505",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/17 11:14:43 Submitted job: 2022-02-17_03_14_43-9481222226626853107
2022/02/17 11:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-17_03_14_43-9481222226626853107?project=apache-beam-testing
2022/02/17 11:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-17_03_14_43-9481222226626853107
2022/02/17 11:14:44 Job state: JOB_STATE_PENDING ...
2022/02/17 11:15:14 Job still running ...
2022/02/17 11:15:44 Job still running ...
2022/02/17 11:16:14 Job still running ...
2022/02/17 11:16:44 Job still running ...
2022/02/17 11:17:14 Job still running ...
2022/02/17 11:17:44 Job still running ...
2022/02/17 11:18:14 Job still running ...
2022/02/17 11:18:44 Failed to execute job: job 2022-02-17_03_14_43-9481222226626853107 failed
panic: Failed to execute job: job 2022-02-17_03_14_43-9481222226626853107 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc000120000, 0x103be9f, 0x19, 0xc0003ffdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/tri3yxcvvjdrq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #422

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/422/display/redirect?page=changes>

Changes:

[stranniknm] [BEAM-13785] playground - enable scio sdk

[mattcasters] [BEAM-13854] Document casting trick for Avro value serializer in KafkaIO

[noreply] Merge pull request #16838 from [BEAM-13931] - make sure large rows cause

[noreply] Seznam Case Study (#16825)

[noreply] [Website] Apache Hop Case Study (#16824)

[noreply] [BEAM-13694] Force hadoop-hdfs-client in hadoopVersion tests for hdfs

[noreply] [Website] Ricardo - added case study feedback (#16807)

[noreply] Merge pull request #16735 from [BEAM-13827] - fix medium file size

[noreply] Merge pull request #16753 from [BEAM-13837] [Playground] show graph on


------------------------------------------
[...truncated 17.07 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1645010104887591299/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/16 11:15:05 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1645010104887591299/model
2022/02/16 11:15:05 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0216100927"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645010104887591299/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1645010104887591299/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0216100927",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/16 11:15:06 Submitted job: 2022-02-16_03_15_05-17086604673332805581
2022/02/16 11:15:06 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-16_03_15_05-17086604673332805581?project=apache-beam-testing
2022/02/16 11:15:06 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-16_03_15_05-17086604673332805581
2022/02/16 11:15:06 Job state: JOB_STATE_PENDING ...
2022/02/16 11:15:36 Job still running ...
2022/02/16 11:16:06 Job still running ...
2022/02/16 11:16:36 Job still running ...
2022/02/16 11:17:06 Job still running ...
2022/02/16 11:17:36 Job still running ...
2022/02/16 11:18:07 Job still running ...
2022/02/16 11:18:37 Failed to execute job: job 2022-02-16_03_15_05-17086604673332805581 failed
panic: Failed to execute job: job 2022-02-16_03_15_05-17086604673332805581 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc000120000, 0x103be9f, 0x19, 0xc0003fddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/beblhzds6cl62

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #421

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/421/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-12712] Spark: Exclude looping timer tests.

[Kyle Weaver] [BEAM-13919] Annotate PerKeyOrderingTest with UsesStatefulParDo.

[noreply] Update 2.36.0 blog post to mention ARM64 support

[noreply] Minor: Disable checker framework in nightly snapshot (#16829)

[artur.khanin] Updated example link

[noreply] [BEAM-13860] Make `DoFn.infer_output_type` return element type (#16788)

[noreply] [BEAM-13894] Unit test utilities in the ptest package (#16830)

[Kenneth Knowles] Add test for processing time continuation trigger

[noreply] [BEAM-13922] [Coverage] Make boot.go more testable and add tests

[noreply] Exclude SpannerChangeStream IT from Dataflow V1 postcommit (#16851)

[noreply] [BEAM-13930] Address StateSpec consistency issue between Runner and Fn


------------------------------------------
[...truncated 17.01 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644923687023089024/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/15 11:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644923687023089024/model
2022/02/15 11:14:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0215101424"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644923687023089024/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644923687023089024/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0215101424",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/15 11:14:48 Submitted job: 2022-02-15_03_14_47-15311826542780482541
2022/02/15 11:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-15_03_14_47-15311826542780482541?project=apache-beam-testing
2022/02/15 11:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-15_03_14_47-15311826542780482541
2022/02/15 11:14:48 Job state: JOB_STATE_PENDING ...
2022/02/15 11:15:18 Job still running ...
2022/02/15 11:15:48 Job still running ...
2022/02/15 11:16:18 Job still running ...
2022/02/15 11:16:48 Job still running ...
2022/02/15 11:17:18 Job still running ...
2022/02/15 11:17:48 Job still running ...
2022/02/15 11:18:18 Failed to execute job: job 2022-02-15_03_14_47-15311826542780482541 failed
panic: Failed to execute job: job 2022-02-15_03_14_47-15311826542780482541 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc00018a000, 0x103be9f, 0x19, 0xc000769df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/m6k7lvjrwpeoe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #420

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/420/display/redirect?page=changes>

Changes:

[akustov] fix name project id from secreton scio deploy action

[alexander.zhuravlev] [BEAM-13775] Fixed bug with run button

[ihr] [BEAM-13836] Fix the answers placeholders locations in the Python katas

[noreply] Merge pull request #16703 from [BEAM-13804][Playground][Bugfix] Add

[noreply] Merge pull request #16611 from [BEAM-13712][Playground] Add graph for

[noreply] Merge pull request #16757 from [BEAM-13655] [Playground] Persist the


------------------------------------------
[...truncated 17.09 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644837278645298099/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/14 11:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644837278645298099/model
2022/02/14 11:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0214100355"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644837278645298099/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644837278645298099/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0214100355",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/14 11:14:39 Submitted job: 2022-02-14_03_14_39-7201007046086799661
2022/02/14 11:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-14_03_14_39-7201007046086799661?project=apache-beam-testing
2022/02/14 11:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-14_03_14_39-7201007046086799661
2022/02/14 11:14:39 Job state: JOB_STATE_PENDING ...
2022/02/14 11:15:09 Job still running ...
2022/02/14 11:15:39 Job still running ...
2022/02/14 11:16:10 Job still running ...
2022/02/14 11:16:40 Job still running ...
2022/02/14 11:17:10 Job still running ...
2022/02/14 11:17:40 Job still running ...
2022/02/14 11:18:10 Failed to execute job: job 2022-02-14_03_14_39-7201007046086799661 failed
panic: Failed to execute job: job 2022-02-14_03_14_39-7201007046086799661 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc000120000, 0x103be9f, 0x19, 0xc000387df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/qh4f34stvnnbq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #419

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/419/display/redirect?page=changes>

Changes:

[randomstep] [BEAM-9195] Bump org.testcontainers to 1.16.3


------------------------------------------
[...truncated 17.07 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644750881307050852/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/13 11:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644750881307050852/model
2022/02/13 11:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0213100358"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644750881307050852/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644750881307050852/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0213100358",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/13 11:14:42 Submitted job: 2022-02-13_03_14_42-5424471729366717367
2022/02/13 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-13_03_14_42-5424471729366717367?project=apache-beam-testing
2022/02/13 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-13_03_14_42-5424471729366717367
2022/02/13 11:14:42 Job state: JOB_STATE_PENDING ...
2022/02/13 11:15:12 Job still running ...
2022/02/13 11:15:42 Job still running ...
2022/02/13 11:16:12 Job still running ...
2022/02/13 11:16:42 Job still running ...
2022/02/13 11:17:12 Job still running ...
2022/02/13 11:17:42 Job still running ...
2022/02/13 11:18:12 Failed to execute job: job 2022-02-13_03_14_42-5424471729366717367 failed
panic: Failed to execute job: job 2022-02-13_03_14_42-5424471729366717367 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc0000480c0, 0x103be9f, 0x19, 0xc000297df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/uuw66kcx2x4hs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #418

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/418/display/redirect?page=changes>

Changes:

[Carl Yeksigian] Cache bucket matcher regex in GcsPath

[benjamin.gonzalez] [BEAM-12672] Retry flaky tests

[benjamin.gonzalez] [BEAM-12672] Fix spotlessApply

[laraschmidt] Fixing the log line to properly handle a large allowed skew.

[n] BEAM-13159 Update embedded-redis dependency

[n] address comments

[noreply] Minor: Add 2.38.0 section to CHANGES.md (#16804)

[noreply] [BEAM-12000] Fix typo in portable Python job definition (#16812)

[noreply] [BEAM-12164]: Fixes SpannerChangeStreamIT (#16806)

[noreply] [BEAM-12572] Fix failures in python examples tests (#16781)

[noreply] [BEAM-13921] filter out debeziumIO test for spark runner (#16815)

[noreply] [BEAM-13855] Skip SpannerChangeStreamOrderedWithinKeyIT and

[noreply] [BEAM-13679] playground - move quick start category to the top (#16808)

[noreply] Update license_script.sh (#16789)

[noreply] [BEAM-13908] [Coverage] Better testing coverage for gcpopts (#16816)

[noreply] Merge pull request #16809 from [BEAM-12164] Added integration test for

[noreply] [BEAM-4032]Support staging binary distributions of dependency packages

[noreply] [BEAM-13834] Increase influxDB persistent storage. (#16817)

[noreply] Minor: Fix link to nexmark benchmarks (#16803)

[noreply] Regenerate python container base_image_requirements.txt (#16832)


------------------------------------------
[...truncated 17.06 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644664532092591491/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/12 11:15:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644664532092591491/model
2022/02/12 11:15:32 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0212100558"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644664532092591491/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644664532092591491/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0212100558",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/12 11:15:34 Submitted job: 2022-02-12_03_15_32-8190254418599552380
2022/02/12 11:15:34 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-12_03_15_32-8190254418599552380?project=apache-beam-testing
2022/02/12 11:15:34 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-12_03_15_32-8190254418599552380
2022/02/12 11:15:34 Job state: JOB_STATE_PENDING ...
2022/02/12 11:16:04 Job still running ...
2022/02/12 11:16:34 Job still running ...
2022/02/12 11:17:04 Job still running ...
2022/02/12 11:17:34 Job still running ...
2022/02/12 11:18:04 Job still running ...
2022/02/12 11:18:34 Job still running ...
2022/02/12 11:19:05 Failed to execute job: job 2022-02-12_03_15_32-8190254418599552380 failed
panic: Failed to execute job: job 2022-02-12_03_15_32-8190254418599552380 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc0000480c0, 0x103be9f, 0x19, 0xc0002c7df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rn7y6qmpqg5is

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #417

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/417/display/redirect>

Changes:


------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
FATAL: java.io.IOException: Pipe closed after 0 cycles
java.io.IOException: Pipe closed after 0 cycles
	at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:118)
	at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:101)
	at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:93)
	at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:74)
	at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:104)
	at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
	at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to apache-beam-jenkins-15
		at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1800)
		at hudson.remoting.Request.call(Request.java:199)
		at hudson.remoting.Channel.call(Channel.java:1000)
		at hudson.FilePath.act(FilePath.java:1249)
		at org.jenkinsci.plugins.envinject.service.EnvironmentVariablesNodeLoader.gatherEnvVarsForNode(EnvironmentVariablesNodeLoader.java:61)
		at org.jenkinsci.plugins.envinject.EnvInjectListener.loadEnvironmentVariablesNode(EnvInjectListener.java:78)
		at org.jenkinsci.plugins.envinject.EnvInjectListener.setUpEnvironment(EnvInjectListener.java:42)
		at hudson.model.AbstractBuild$AbstractBuildExecution.createLauncher(AbstractBuild.java:604)
		at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:472)
		at hudson.model.Run.execute(Run.java:1906)
		at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
		at hudson.model.ResourceController.execute(ResourceController.java:97)
		at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.remoting.RequestAbortedException
	at hudson.remoting.Request.abort(Request.java:345)
	at hudson.remoting.Channel.terminate(Channel.java:1085)
	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:89)
ERROR: apache-beam-jenkins-15 is offline; cannot locate jdk_1.8_latest

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #416

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/416/display/redirect?page=changes>

Changes:

[david.prieto.rivera] Missing contribution

[noreply] [BEAM-13803] Add support for native iterable side inputs to the Go SDK

[noreply] [BEAM-11095] Better error handling for illegal emit functions (#16776)

[noreply] Merge pull request #16613 from Supporting JdbcIO driver in classpath for

[noreply] Merge pull request #15848 from [BEAM-13835] An any-type implementation

[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define simple generators.

[Valentyn Tymofieiev] Add a container for Python 3.9.

[Valentyn Tymofieiev] Allow job submission with Python 3.9 on Dataflow runner

[Valentyn Tymofieiev] Add Python 3.9 test suites. Keep Dataflow V1 suites unchanged for now.

[Valentyn Tymofieiev] Add py3.9 Github actions suites.

[Valentyn Tymofieiev] Py39 Doc updates.

[Valentyn Tymofieiev] [BEAM-9980] Simplify run_validates_container.sh to avoid branching.

[Valentyn Tymofieiev] Update Cython to a new version that has py39 wheels.

[Valentyn Tymofieiev] [BEAM-13845] Fix comparison with potentially incomparable default

[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define simple generators.

[Valentyn Tymofieiev] Mark Python 3.9 as supported version.

[noreply] [release-2.36.0][website] Fix github release notes script, header for

[noreply] Use shell to run python for setupVirtualenv (#16796)

[Daniel Oliveira] [BEAM-13830] Properly shut down Debezium expansion service in IT script.

[noreply] Merge pull request #16659 from [BEAM-13774][Playground] Add user to

[Valentyn Tymofieiev] [BEAM-13868] Remove gsutil dep from hdfs IT test.

[noreply] [BEAM-13776][Playground] (#16731)

[noreply] [BEAM-13867] Drop NaNs returned by nlargest in flight_delays example

[noreply] Announce Python 3.9 in CHANGES.md (#16802)

[Brian Hulette] Moving to 2.38.0-SNAPSHOT on master branch.

[noreply] [BEAM-11095] Better error handling for iter/reiter/multimap (#16794)


------------------------------------------
[...truncated 17.06 KB...]
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c4"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.38.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644491688325745413/****\022@21cad7fd04db3da959b95a9a5584e98717d84b76b3f88353cd98bd37282f127e"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/10 11:14:49 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644491688325745413/model
2022/02/10 11:14:49 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0210100406"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.38.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644491688325745413/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.38.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644491688325745413/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.38.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.38.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0210100406",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/10 11:14:50 Submitted job: 2022-02-10_03_14_49-2471329424471990151
2022/02/10 11:14:50 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-10_03_14_49-2471329424471990151?project=apache-beam-testing
2022/02/10 11:14:50 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-10_03_14_49-2471329424471990151
2022/02/10 11:14:50 Job state: JOB_STATE_PENDING ...
2022/02/10 11:15:20 Job still running ...
2022/02/10 11:15:50 Job still running ...
2022/02/10 11:16:20 Job still running ...
2022/02/10 11:16:50 Job still running ...
2022/02/10 11:17:20 Job still running ...
2022/02/10 11:17:50 Job still running ...
2022/02/10 11:18:20 Failed to execute job: job 2022-02-10_03_14_49-2471329424471990151 failed
panic: Failed to execute job: job 2022-02-10_03_14_49-2471329424471990151 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114e428, 0xc0000480c0, 0x103be9f, 0x19, 0xc00081fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 57s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dsnslgpyjdfl2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #415

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/415/display/redirect?page=changes>

Changes:

[noreply] Update README.md

[marco.robles] Update README with latest PreCommit Jobs

[marco.robles] Update Postcommit jobs with latest jobs

[marco.robles] Update Performace job tests in readme

[marco.robles] update load job tests with latest updates

[marco.robles] update other jobs test with latest updates

[marco.robles] mismatch links fix

[marco.robles] update trigger phrase for some postCommit jobs

[marco.robles] correct trigger phrases in readme

[marco.robles] add pending jobs to readme

[noreply] Update README.md

[mmack] [BEAM-13246] Add support for S3 Bucket Key at the object level (AWS Sdk

[Pablo Estrada] Output successful rows from BQ Streaming Inserts

[schapman] BEAM-13439 Type annotation for ptransform_fn

[noreply] [BEAM-13606] Fail bundles with failed BigTable mutations (#16751)

[mmack] [adhoc] Remove remaining usage of Powermock from aws2.

[marco.robles] fix broken links in jobs & remove the invalid ones

[Kyle Weaver] Update Dataflow Python dev container images.

[Kiley Sok] Add java 17 to changes

[noreply] [BEAM-12914] Add missing 3.9 opcodes to type inference. (#16761)

[noreply] [BEAM-13321] Initial BigQueryIO externalization. (#16489)

[noreply] [BEAM-13193] Enable process bundle response elements embedding in Java

[noreply] [BEAM-13830] added a debeziumio_expansion_addr flag to GoSDK (#16780)

[noreply] Apply spotless. (#16783)

[Daniel Oliveira] [BEAM-13732] Switch x-lang BigQueryIO expansion service to GCP one.

[noreply] [BEAM-13858] Fix broken github action on :sdks:go:examples:wordCount

[Kiley Sok] add jira for runner v2

[noreply] [BEAM-13732] Go SDK BigQuery IO wrapper. Initial implementation.

[noreply] [BEAM-13732] Add example for Go BigQuery IO wrapper. (#16786)

[noreply] Update CHANGES.md with Go SDK milestones. (#16787)

[noreply] [BEAM-13193] Allow BeamFnDataOutboundObserver to flush elements.


------------------------------------------
[...truncated 17.87 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644405312281552018/****\022@587aeb3045cd3c78fb52d894fb1cf01902460d7a9e1b2953efac48e7f4c2926c"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/09 11:15:13 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644405312281552018/model
2022/02/09 11:15:13 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0209100830"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644405312281552018/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644405312281552018/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0209100830",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/09 11:15:13 Submitted job: 2022-02-09_03_15_13-6681294479557400280
2022/02/09 11:15:13 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-09_03_15_13-6681294479557400280?project=apache-beam-testing
2022/02/09 11:15:13 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-09_03_15_13-6681294479557400280
2022/02/09 11:15:13 Job state: JOB_STATE_PENDING ...
2022/02/09 11:15:43 Job still running ...
2022/02/09 11:16:13 Job still running ...
2022/02/09 11:16:43 Job still running ...
2022/02/09 11:17:14 Job still running ...
2022/02/09 11:17:44 Job still running ...
2022/02/09 11:18:14 Job still running ...
2022/02/09 11:18:44 Failed to execute job: job 2022-02-09_03_15_13-6681294479557400280 failed
panic: Failed to execute job: job 2022-02-09_03_15_13-6681294479557400280 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114cd68, 0xc000198000, 0x103aaf6, 0x19, 0xc000559df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 18s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/j3msdxqbt5brw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #414

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/414/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-12976] Log projection pushdown optimizations.

[benjamin.gonzalez] [BEAM-12572] Change jobs to run as cron jobs

[Ismaël Mejía] [BEAM-13839] Upgrade zstd-jni to version 1.5.2-1

[mmack] [BEAM-13840] Fix usage of legacy rawtypes in AWS modules

[alexander.zhuravlev] [BEAM-13820] Changed color of delete icon in pipeline options dropdown,

[noreply] [BEAM-11971] Revert "Fix timer consistency in direct runner" (#16748)

[noreply] [BEAM-13193] Aggregates fn api outbound data/timers of different

[noreply] [BEAM-13767] Migrate a bundle of grade tasks to use configuration

[noreply] Merge pull request #16653 from [BEAM-12164]: Add integration tests for

[noreply] Merge pull request #16728 from [BEAM-13823] Update docs for SnowflakeIO

[noreply] Merge pull request #16660 from [BEAM-13771][Playground] Send multifile

[noreply] Merge pull request #16646 from [BEAM-13643][Playground] Setup running

[noreply] [BEAM-13015] Add state caching benchmark and move benchmarks to their

[noreply] [BEAM-13419] Check for initialization in dataflow runner (#16765)

[noreply] Merge pull request #16701 from [BEAM-13786] [Playground] [Bugfix] Update

[noreply] Merge pull request #16754 from [BEAM-13838][Playground] Add logs in case

[noreply] [BEAM-13293] consistent naming for expansion service address and flag

[noreply] Merge pull request #16700 from [BEAM-13790][Playground] Change logic of

[noreply] [BEAM-13830] update dependency for debeziumio expansion service (#16743)

[noreply] [BEAM-13761] consistent namings for expansion address in Debezium IO

[noreply] [BEAM-13806] Shutting down SchemaIO expansion services from Go VR

[noreply] [release-2.36.0] Update website/changelog for release 2.36.0 (#16627)

[noreply] [BEAM-13848] Update numpy intersphinx link (#16767)

[noreply] [release-23.6.0] Fix JIRA link for 2.36 blog (#16771)

[noreply] [BEAM-13647] Use role for Go worker binary. (#16729)


------------------------------------------
[...truncated 17.80 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:url:v1"
        type_payload: "\nJgs://temp-storage-for-perf-tests/loadtests/go-1-1644318897720659817/****\022@587aeb3045cd3c78fb52d894fb1cf01902460d7a9e1b2953efac48e7f4c2926c"
        role_urn: "beam:artifact:role:go_****_binary:v1"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/08 11:14:58 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644318897720659817/model
2022/02/08 11:14:58 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0208100622"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644318897720659817/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644318897720659817/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0208100622",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/08 11:14:59 Submitted job: 2022-02-08_03_14_58-3199055847669511213
2022/02/08 11:14:59 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-08_03_14_58-3199055847669511213?project=apache-beam-testing
2022/02/08 11:14:59 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-08_03_14_58-3199055847669511213
2022/02/08 11:14:59 Job state: JOB_STATE_PENDING ...
2022/02/08 11:15:32 Job still running ...
2022/02/08 11:16:02 Job still running ...
2022/02/08 11:16:32 Job still running ...
2022/02/08 11:17:02 Job still running ...
2022/02/08 11:17:32 Job still running ...
2022/02/08 11:18:02 Job still running ...
2022/02/08 11:18:32 Failed to execute job: job 2022-02-08_03_14_58-3199055847669511213 failed
panic: Failed to execute job: job 2022-02-08_03_14_58-3199055847669511213 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114cd68, 0xc000120000, 0x103aaf6, 0x19, 0xc000561df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 10s
12 actionable tasks: 10 executed, 1 from cache, 1 up-to-date

Publishing build scan...
https://gradle.com/s/6mlkg2fmv55k6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #413

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/413/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #16726 from [BEAM-12164]: Parses change streams

[mmack] [BEAM-13147] Avoid nullness issue during init of AwsModule (AWS Sdk v2)


------------------------------------------
[...truncated 18.45 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/07 15:33:32 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644248011227794739/model
2022/02/07 15:33:32 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0207144926"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644248011227794739/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644248011227794739/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0207144926",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/07 15:33:32 Submitted job: 2022-02-07_07_33_32-4769923595035682520
2022/02/07 15:33:32 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-07_07_33_32-4769923595035682520?project=apache-beam-testing
2022/02/07 15:33:32 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-07_07_33_32-4769923595035682520
2022/02/07 15:33:32 Job state: JOB_STATE_PENDING ...
2022/02/07 15:34:02 Job still running ...
2022/02/07 15:34:32 Job still running ...
2022/02/07 15:35:02 Job still running ...
2022/02/07 15:35:33 Job still running ...
2022/02/07 15:36:03 Job still running ...
2022/02/07 15:36:33 Job still running ...
2022/02/07 15:37:03 Failed to execute job: job 2022-02-07_07_33_32-4769923595035682520 failed
panic: Failed to execute job: job 2022-02-07_07_33_32-4769923595035682520 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114b968, 0xc000120000, 0x10399f6, 0x19, 0xc0003f5df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 59s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/m3f2fir7an3hm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #412

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/412/display/redirect?page=changes>

Changes:

[mmack] [BEAM-13663] Remove unused duplicate option for AWS client configuration

[mmack] [BEAM-13203] Deprecate SnsIO.writeAsync for AWS Sdk v2 due to risk of

[noreply] [BEAM-13828] Fix stale bot (#16734)

[noreply] Merge pull request #16364 from [BEAM-13182]  Add diagrams to backend

[noreply] [BEAM-13811] Fix save_main_session arg in tests examples (#16709)

[Kiley Sok] Update beam-master version

[noreply] [BEAM-13015] Calculate exception for closing BeamFnDataInboundObserver2

[noreply] Minor doc tweaks for validating vendoring. (#16747)

[noreply] [BEAM-13686] OOM while logging a large pipeline even when logging level

[noreply] [BEAM-13629] Update URL artifact type for Dataflow Go (#16490)

[noreply] [BEAM-13832] Add automated expansion service start-up to JDBCio (#16739)

[noreply] [BEAM-13831] Add automated expansion service infra into Debezium Read()

[noreply] [BEAM-13821] Add automated expansion service start-up to KafkaIO

[noreply] [BEAM-13799] Created a Dataproc cluster manager for Interactive Beam

[noreply] Merge pull request #16727: [BEAM-11971] remove unsafe Concurrent data


------------------------------------------
[...truncated 18.39 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/05 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1644059681117751546/model
2022/02/05 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0205100728"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644059681117751546/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1644059681117751546/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0205100728",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/05 11:14:42 Submitted job: 2022-02-05_03_14_41-10194427339715935817
2022/02/05 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-05_03_14_41-10194427339715935817?project=apache-beam-testing
2022/02/05 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-05_03_14_41-10194427339715935817
2022/02/05 11:14:42 Job state: JOB_STATE_PENDING ...
2022/02/05 11:15:12 Job still running ...
2022/02/05 11:15:42 Job still running ...
2022/02/05 11:16:12 Job still running ...
2022/02/05 11:16:42 Job still running ...
2022/02/05 11:17:12 Job still running ...
2022/02/05 11:17:42 Job still running ...
2022/02/05 11:18:12 Failed to execute job: job 2022-02-05_03_14_41-10194427339715935817 failed
panic: Failed to execute job: job 2022-02-05_03_14_41-10194427339715935817 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114b968, 0xc0000480c0, 0x10399f6, 0x19, 0xc0007cbdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7ua3qt2igsemk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #411

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/411/display/redirect?page=changes>

Changes:

[Kiley Sok] Allow Java 17 to be used in SDK

[Kiley Sok] add testing support

[Kiley Sok] Add more testing support for java 17

[Kiley Sok] workaround for jamm

[Kiley Sok] Add Jenkins test for Java 17

[Kiley Sok] Fix jvm hex and skip errorprone

[Kiley Sok] Fix display data for anonymous classes

[Kiley Sok] fix jpms tests

[Kiley Sok] skip zetasql

[Kiley Sok] spotless

[Kiley Sok] spotless

[Kiley Sok] Fix trigger

[Kiley Sok] skip checker framework

[Kiley Sok] fix app name

[Kiley Sok] remove duplicate property check

[Heejong Lee] [BEAM-13813] Add support for URL artifact to extractStagingToPath

[avilovpavel6] Remove Python SQL Test example from catalog

[relax] Fix timer consistency in direct runner

[noreply] [BEAM-13757] adds pane observation in DoFn (#16629)

[Jan Lukavský] Change links to Books from Amazon to Publisher

[noreply] [BEAM-13605] Add support for pandas 1.4.0 (#16590)

[noreply] [BEAM-13761] adds Debezium IO wrapper for Go SDK (#16642)

[noreply] [BEAM-13024] Unify PipelineOptions behavior (#16719)

[noreply] Update sdks/go/pkg/beam/artifact/materialize_test.go

[noreply] Merge pull request #16605 from [BEAM-13634][Playground] Create a

[noreply] Merge pull request #16593 from [BEAM-13725][Playground] Add graph to the

[noreply] Merge pull request #16699 from [BEAM-13789][Playground] Change logic of

[alexander.chermenin] Fixed CSS for Case study page


------------------------------------------
[...truncated 18.37 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/04 11:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643973284344462899/model
2022/02/04 11:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0204100354"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643973284344462899/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643973284344462899/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0204100354",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/04 11:14:45 Submitted job: 2022-02-04_03_14_45-5440143625919878930
2022/02/04 11:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-04_03_14_45-5440143625919878930?project=apache-beam-testing
2022/02/04 11:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-04_03_14_45-5440143625919878930
2022/02/04 11:14:45 Job state: JOB_STATE_PENDING ...
2022/02/04 11:15:16 Job still running ...
2022/02/04 11:15:46 Job still running ...
2022/02/04 11:16:16 Job still running ...
2022/02/04 11:16:46 Job still running ...
2022/02/04 11:17:16 Job still running ...
2022/02/04 11:17:46 Job still running ...
2022/02/04 11:18:16 Failed to execute job: job 2022-02-04_03_14_45-5440143625919878930 failed
panic: Failed to execute job: job 2022-02-04_03_14_45-5440143625919878930 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x114b8a8, 0xc000120000, 0x10399f6, 0x19, 0xc00041ddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/b763apy7qjkjg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #410

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/410/display/redirect?page=changes>

Changes:

[aydar.zaynutdinov] [BEAM-13737][Playground]

[Robert Bradshaw] Make num-stages counter into an internal counter.

[Kenneth Knowles] [BEAM-13768] Fix NullPointerException in BigQueryStorageSourceBase

[Robert Bradshaw] Avoid packaging avro in the java harness jar.

[mmack] [BEAM-13563] Restructure Kinesis Source for Aws 2 internally to prepare

[noreply] [BEAM-4665] Allow joining a running dataflow pipeline without throwing

[noreply] [BEAM-13801] Add standard coder tests for state backed iterable.

[noreply] [BEAM-13430]  Fix provided configuration by removing extendsFrom for

[noreply] [BEAM-12830] Print clearer go version fail message (#16693)

[Jan Lukavský] Add reference to Books to Learning Resources in website

[noreply] Use ThreadLocal for DESERIALIZATION_CONTEXT (#16680)

[noreply] Minor: Add apt update after adding deadsnakes repository in dev env

[noreply] [BEAM-13807] Regenerate container images to get TF 2.8.0 (#16707)

[noreply] [BEAM-13399, BEAM-13683] Eagerly materialize artifacts for automated

[noreply] Merge pull request #16617 from [BEAM-13743] [Playground] Add context

[noreply] Merge pull request #16618 from [BEAM-13744] [Playground] Add context

[noreply] Merge pull request #16698 from [BEAM-13802][Playground] [Bugfix] Clean

[noreply] [BEAM-13293][BEAM-13806] Pipe a SchemaIO flag through Go integration

[noreply] [BEAM-13605] Modify groupby.apply implementation in preparation for

[noreply] Merge pull request #16436 from [BEAM-1330] - DatastoreIO Writes should


------------------------------------------
[...truncated 18.44 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/03 16:16:59 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643905018936283747/model
2022/02/03 16:16:59 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0203153300"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643905018936283747/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643905018936283747/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0203153300",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/03 16:17:00 Submitted job: 2022-02-03_08_16_59-13554466823964953942
2022/02/03 16:17:00 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-03_08_16_59-13554466823964953942?project=apache-beam-testing
2022/02/03 16:17:00 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-03_08_16_59-13554466823964953942
2022/02/03 16:17:00 Job state: JOB_STATE_PENDING ...
2022/02/03 16:17:30 Job still running ...
2022/02/03 16:18:00 Job still running ...
2022/02/03 16:18:30 Job still running ...
2022/02/03 16:19:00 Job still running ...
2022/02/03 16:19:30 Job still running ...
2022/02/03 16:20:00 Job still running ...
2022/02/03 16:20:31 Failed to execute job: job 2022-02-03_08_16_59-13554466823964953942 failed
panic: Failed to execute job: job 2022-02-03_08_16_59-13554466823964953942 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11496a8, 0xc0000480c0, 0x1037972, 0x19, 0xc00054bdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/atwhcc2mipz2s

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #409

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/409/display/redirect?page=changes>

Changes:

[career] [BEAM-13734] Support cache directories that use GCS buckets

[noreply] Merge pull request #16655 from [BEAM-12164]: Add retry protection to

[noreply] Merge pull request #16586 from [BEAM-13731] FhirIO: Add support for

[noreply] [BEAM-13011] Adds a link to Multi-language Pipelines Tips wiki page

[noreply] [BEAM-12572] Run python examples on multiple runners (#16154)

[noreply] [BEAM-13574] Large Wordcount (#16455)

[noreply] [BEAM-13293] Refactor JDBC IO Go Wrapper (#16686)

[noreply] Edit license script for Java, add manual licenses for xz (#16692)


------------------------------------------
[...truncated 18.38 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/02 11:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643800481829193858/model
2022/02/02 11:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0202100358"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643800481829193858/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643800481829193858/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0202100358",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/02 11:14:44 Submitted job: 2022-02-02_03_14_42-1265149328146991666
2022/02/02 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-02_03_14_42-1265149328146991666?project=apache-beam-testing
2022/02/02 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-02_03_14_42-1265149328146991666
2022/02/02 11:14:44 Job state: JOB_STATE_PENDING ...
2022/02/02 11:15:15 Job still running ...
2022/02/02 11:15:45 Job still running ...
2022/02/02 11:16:15 Job still running ...
2022/02/02 11:16:45 Job still running ...
2022/02/02 11:17:15 Job still running ...
2022/02/02 11:17:45 Job still running ...
2022/02/02 11:18:15 Failed to execute job: job 2022-02-02_03_14_42-1265149328146991666 failed
panic: Failed to execute job: job 2022-02-02_03_14_42-1265149328146991666 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11477a8, 0xc000120000, 0x1035e35, 0x19, 0xc000817df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dms7bkwi7tawm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #408

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/408/display/redirect?page=changes>

Changes:

[daria.malkova] Support SCIO SDK via sbt projects

[samuelw] [BEAM-11648] Share thread pool across RetryManager instances.

[Pablo Estrada] Exclude per-key order tests on Twister2 runner

[mrudary] Generalize S3FileSystem to support multiple URI schemes.

[Heejong Lee] Fix Java SDK container image name for load-tests and nexmark

[daria.malkova] Change executable name fo go tests

[avilovpavel6] Fix java test

[noreply] [BEAM-13769] Skip test_main_session_not_staged_when_using_cloudpickle

[noreply] [BEAM-6744] Support implicitly setting project id in Go Dataflow runner

[noreply] Merge pull request #16493 from [BEAM-13632][Playground] Save catalog

[noreply] Exclude jul-to-slf4j from Spark runner in quickstart POM templates

[noreply] [BEAM-11936] Enable a few errorprone checks that were broken by pinned

[noreply] [BEAM-13780] Add CONTRIBUTING.md pointing to main guide (#16666)

[noreply] [BEAM-13777] Accept cache capacity as input parameter instead of default

[noreply] [BEAM-13051][A] Enable pylint warnings

[noreply] [BEAM-13779] Fix pr labeling (#16665)

[noreply] Merge pull request #16581 from [BEAM-12164]: Add

[noreply] Fix labeler trigger (#16674)

[noreply] [BEAM-13781] Exclude grpc-netty-shaded from gax-grpc's dependency

[noreply] [BEAM-13051] Fixed pylint warnings : raising-non-exception (E0710),

[noreply] [BEAM-13740] Correctly install go before running tests (#16673)

[noreply] [BEAM-12830] Update local Docker env Go version. (#16670)

[noreply] [BEAM-13051][B] Enable pylint warnings

[noreply] [BEAM-13430] Revert Spark libraries in Spark runner to provided (#16675)

[noreply] [BEAM-12240] Add Java 17 support (#16568)

[noreply] [BEAM-13760] Add random component to default python dataflow job name


------------------------------------------
[...truncated 18.39 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/02/01 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643714081019721766/model
2022/02/01 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0201100345"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643714081019721766/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643714081019721766/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0201100345",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/02/01 11:14:42 Submitted job: 2022-02-01_03_14_41-6062868831477880493
2022/02/01 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-02-01_03_14_41-6062868831477880493?project=apache-beam-testing
2022/02/01 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-02-01_03_14_41-6062868831477880493
2022/02/01 11:14:42 Job state: JOB_STATE_PENDING ...
2022/02/01 11:15:12 Job still running ...
2022/02/01 11:15:42 Job still running ...
2022/02/01 11:16:12 Job still running ...
2022/02/01 11:16:42 Job still running ...
2022/02/01 11:17:12 Job still running ...
2022/02/01 11:17:42 Job still running ...
2022/02/01 11:18:12 Failed to execute job: job 2022-02-01_03_14_41-6062868831477880493 failed
panic: Failed to execute job: job 2022-02-01_03_14_41-6062868831477880493 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11477a8, 0xc0000480d0, 0x1035e35, 0x19, 0xc000443df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ugeskxh2acoac

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #407

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/407/display/redirect>

Changes:


------------------------------------------
[...truncated 18.36 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/31 11:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643627676793465766/model
2022/01/31 11:14:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0131100355"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643627676793465766/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643627676793465766/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0131100355",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/31 11:14:38 Submitted job: 2022-01-31_03_14_37-11434314271509460229
2022/01/31 11:14:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-31_03_14_37-11434314271509460229?project=apache-beam-testing
2022/01/31 11:14:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-31_03_14_37-11434314271509460229
2022/01/31 11:14:38 Job state: JOB_STATE_PENDING ...
2022/01/31 11:15:08 Job still running ...
2022/01/31 11:15:38 Job still running ...
2022/01/31 11:16:08 Job still running ...
2022/01/31 11:16:38 Job still running ...
2022/01/31 11:17:08 Job still running ...
2022/01/31 11:17:38 Job still running ...
2022/01/31 11:18:08 Failed to execute job: job 2022-01-31_03_14_37-11434314271509460229 failed
panic: Failed to execute job: job 2022-01-31_03_14_37-11434314271509460229 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11477a8, 0xc0000480d0, 0x1035e35, 0x19, 0xc000453df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/3imjowwehktn6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #406

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/406/display/redirect>

Changes:


------------------------------------------
[...truncated 18.39 KB...]
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/30 11:14:29 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643541269180503430/model
2022/01/30 11:14:29 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0130100332"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643541269180503430/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643541269180503430/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0130100332",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/30 11:14:30 Submitted job: 2022-01-30_03_14_29-18309125727860954465
2022/01/30 11:14:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-30_03_14_29-18309125727860954465?project=apache-beam-testing
2022/01/30 11:14:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-30_03_14_29-18309125727860954465
2022/01/30 11:14:30 Job state: JOB_STATE_PENDING ...
2022/01/30 11:15:00 Job still running ...
2022/01/30 11:15:30 Job still running ...
2022/01/30 11:16:00 Job still running ...
2022/01/30 11:16:30 Job still running ...
2022/01/30 11:17:00 Job still running ...
2022/01/30 11:17:30 Job still running ...
2022/01/30 11:18:00 Job still running ...
2022/01/30 11:18:30 Job still running ...
2022/01/30 11:19:01 Job still running ...
2022/01/30 11:19:31 Job still running ...
2022/01/30 11:20:01 Failed to execute job: job 2022-01-30_03_14_29-18309125727860954465 failed
panic: Failed to execute job: job 2022-01-30_03_14_29-18309125727860954465 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11477a8, 0xc000198000, 0x1035e35, 0x19, 0xc0006dddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 5m 39s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/l2pvdhf3jlx4k

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #405

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/405/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-13751] Don't block on gcloud when attempting to get default GCP

[Kyle Weaver] [BEAM-13751] Parameterize wait timeout so test doesn't waste 2s.

[Kyle Weaver] [BEAM-13751] Add comment explaining sleep.

[noreply] Update Python SDK beam-master tags (#16630)

[noreply] Merge pull request #16592 from [BEAM-13722][Playground] Add precompiling

[noreply] Merge pull request #16505 from [BEAM-13527] [Playground] Pipeline

[noreply] [BEAM-13293] XLang Jdbc IO for Go SDK (#16111)

[noreply] [BEAM-10206] Add Go Vet to Github Actions (#16612)


------------------------------------------
[...truncated 18.36 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/29 11:14:42 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643454881746600832/model
2022/01/29 11:14:42 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0129100406"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643454881746600832/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643454881746600832/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0129100406",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/29 11:14:43 Submitted job: 2022-01-29_03_14_42-3720015953053969380
2022/01/29 11:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-29_03_14_42-3720015953053969380?project=apache-beam-testing
2022/01/29 11:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-29_03_14_42-3720015953053969380
2022/01/29 11:14:43 Job state: JOB_STATE_PENDING ...
2022/01/29 11:15:13 Job still running ...
2022/01/29 11:15:43 Job still running ...
2022/01/29 11:16:13 Job still running ...
2022/01/29 11:16:44 Job still running ...
2022/01/29 11:17:14 Job still running ...
2022/01/29 11:17:44 Job still running ...
2022/01/29 11:18:14 Failed to execute job: job 2022-01-29_03_14_42-3720015953053969380 failed
panic: Failed to execute job: job 2022-01-29_03_14_42-3720015953053969380 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11477a8, 0xc0000480d0, 0x1035e35, 0x19, 0xc0006b7df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/s7ef44le6wxsi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #404

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/404/display/redirect?page=changes>

Changes:

[marcin.kuthan] Get rid of unnessecary logs for BigQuery streaming writes in

[dhuntsperger] added GitHub example references to Python multilang quickstart

[mmack] [adhoc] Test S3Options and AwsOptions for Sdk v2

[noreply] [BEAM-13537] Fix NPE in kafkatopubsub example (#16625)

[noreply] [BEAM-13740] update java_tests.yml to remove setup-go, which is

[Heejong Lee] Fix google3 import error

[noreply] [BEAM-12976] Implement Java projection pushdown optimizer. (#16513)

[noreply] Merge pull request #16579 from Revert "Revert "Merge pull request #15863

[noreply] Merge pull request #16606 from [BEAM-13247] [Playground] Embedding


------------------------------------------
[...truncated 18.36 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/28 11:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643368482544021713/model
2022/01/28 11:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0128100402"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643368482544021713/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643368482544021713/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0128100402",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/28 11:14:46 Submitted job: 2022-01-28_03_14_43-10091544629937618276
2022/01/28 11:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-28_03_14_43-10091544629937618276?project=apache-beam-testing
2022/01/28 11:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-28_03_14_43-10091544629937618276
2022/01/28 11:14:46 Job state: JOB_STATE_PENDING ...
2022/01/28 11:15:16 Job still running ...
2022/01/28 11:15:46 Job still running ...
2022/01/28 11:16:16 Job still running ...
2022/01/28 11:16:46 Job still running ...
2022/01/28 11:17:16 Job still running ...
2022/01/28 11:17:46 Job still running ...
2022/01/28 11:18:16 Failed to execute job: job 2022-01-28_03_14_43-10091544629937618276 failed
panic: Failed to execute job: job 2022-01-28_03_14_43-10091544629937618276 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11461e8, 0xc0000480b0, 0x1034b9c, 0x19, 0xc00042bdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 55s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/afcydawnos2gs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #403

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/403/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-13093] Enable JavaUsingPython CrossLanguageValidateRunner test for

[mmack] [BEAM-8807] Add integration test for SnsIO.write (Sdk v1 & v2)

[mmack] [BEAM-13746] Fix deserialization of SSECustomerKey for AWS Sdk v2

[noreply] [BEAM-7928] Allow users to specify worker disk type for Dataflow runner

[noreply] Merge pull request #16534 from [BEAM-13671][Playground] Add backend

[noreply] [BEAM-13271] Bump errorprone to 2.10.0 (#16231)

[noreply] [BEAM-13595] Don't load main session when cloudpickle is used. (#16589)

[Heejong Lee] Update readme for XVR tests


------------------------------------------
[...truncated 18.39 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/27 11:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643282082975049451/model
2022/01/27 11:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0127100352"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643282082975049451/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643282082975049451/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0127100352",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/27 11:14:44 Submitted job: 2022-01-27_03_14_43-4710017466923166776
2022/01/27 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-27_03_14_43-4710017466923166776?project=apache-beam-testing
2022/01/27 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-27_03_14_43-4710017466923166776
2022/01/27 11:14:44 Job state: JOB_STATE_PENDING ...
2022/01/27 11:15:14 Job still running ...
2022/01/27 11:15:44 Job still running ...
2022/01/27 11:16:14 Job still running ...
2022/01/27 11:16:44 Job still running ...
2022/01/27 11:17:14 Job still running ...
2022/01/27 11:17:45 Job still running ...
2022/01/27 11:18:17 Failed to execute job: job 2022-01-27_03_14_43-4710017466923166776 failed
panic: Failed to execute job: job 2022-01-27_03_14_43-4710017466923166776 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11461e8, 0xc000120000, 0x1034b9c, 0x19, 0xc00069fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wzcbrnvhesa26

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #402

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/402/display/redirect?page=changes>

Changes:

[artur.khanin] Privacy policy update regarding Apache Beam Playground

[Daniel Oliveira] [BEAM-13321] Fix exception with BigQuery StreamWriter TraceID.

[mmack] [BEAM-13510] Don't retry on invalid SQS receipt handles.

[noreply] [BEAM-13736] Make lifting cache exact. (#16603)

[noreply] Merge pull request #16565 from [BEAM-13692][Playground]  Implement

[noreply] Merge pull request #16502 from [BEAM-13650][Playground] Add link for

[noreply] [BEAM-13310] remove call to get offset consumer config, which was rep…


------------------------------------------
[...truncated 18.40 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/26 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643195680515054399/model
2022/01/26 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0126100406"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643195680515054399/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643195680515054399/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0126100406",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/26 11:14:42 Submitted job: 2022-01-26_03_14_41-10231529111741676518
2022/01/26 11:14:42 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-26_03_14_41-10231529111741676518?project=apache-beam-testing
2022/01/26 11:14:42 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-26_03_14_41-10231529111741676518
2022/01/26 11:14:42 Job state: JOB_STATE_PENDING ...
2022/01/26 11:15:12 Job still running ...
2022/01/26 11:15:42 Job still running ...
2022/01/26 11:16:12 Job still running ...
2022/01/26 11:16:42 Job still running ...
2022/01/26 11:17:12 Job still running ...
2022/01/26 11:17:42 Job still running ...
2022/01/26 11:18:12 Failed to execute job: job 2022-01-26_03_14_41-10231529111741676518 failed
panic: Failed to execute job: job 2022-01-26_03_14_41-10231529111741676518 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1145188, 0xc0000480b0, 0x1033b73, 0x19, 0xc0003e1df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 51s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/hd4glxjgs53zy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #401

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/401/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-13716] Clear before creating a new virtual environment in

[mmack] [BEAM-13653] Make SnsIO.write topicArn optional. If provided, validate

[noreply] [BEAM-10897] Update the fastavro lower bound due to an issue on Windows

[noreply] [BEAM-13605] Update pandas_doctests_test denylists in preparation for

[noreply] Merge pull request #16538 from [BEAM-13676][Playground][Bugfix]Build Of

[noreply] Merge pull request #16582 from [BEAM-13711] [Playground] [Bugfix] Add

[noreply] Merge pull request #16515 from [BEAM-13636] [Playground] Checking the

[ningkang0957] [BEAM-13275] Removed the explicit selenium dependency from setup

[noreply] [BEAM-10206] Deprecate unused shallow cloning functions (#16600)

[noreply] Bump Dataflow container versions (#16602)

[noreply] Improved multi-language pipelines section of the programming guide


------------------------------------------
[...truncated 18.39 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/25 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643109280515943070/model
2022/01/25 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0125100353"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643109280515943070/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643109280515943070/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0125100353",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/25 11:14:41 Submitted job: 2022-01-25_03_14_41-4093120537584147620
2022/01/25 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-25_03_14_41-4093120537584147620?project=apache-beam-testing
2022/01/25 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-25_03_14_41-4093120537584147620
2022/01/25 11:14:41 Job state: JOB_STATE_PENDING ...
2022/01/25 11:15:12 Job still running ...
2022/01/25 11:15:42 Job still running ...
2022/01/25 11:16:12 Job still running ...
2022/01/25 11:16:42 Job still running ...
2022/01/25 11:17:12 Job still running ...
2022/01/25 11:17:42 Job still running ...
2022/01/25 11:18:12 Failed to execute job: job 2022-01-25_03_14_41-4093120537584147620 failed
panic: Failed to execute job: job 2022-01-25_03_14_41-4093120537584147620 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144b88, 0xc000120000, 0x1033693, 0x19, 0xc0002d3df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 53s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/otyv6tgthonwi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #400

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/400/display/redirect>

Changes:


------------------------------------------
[...truncated 18.37 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/24 11:14:43 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1643022882629238080/model
2022/01/24 11:14:43 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0124100336"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643022882629238080/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1643022882629238080/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0124100336",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/24 11:14:44 Submitted job: 2022-01-24_03_14_43-10625602788189603585
2022/01/24 11:14:44 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-24_03_14_43-10625602788189603585?project=apache-beam-testing
2022/01/24 11:14:44 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-24_03_14_43-10625602788189603585
2022/01/24 11:14:44 Job state: JOB_STATE_PENDING ...
2022/01/24 11:15:14 Job still running ...
2022/01/24 11:15:44 Job still running ...
2022/01/24 11:16:14 Job still running ...
2022/01/24 11:16:44 Job still running ...
2022/01/24 11:17:14 Job still running ...
2022/01/24 11:17:44 Job still running ...
2022/01/24 11:18:14 Failed to execute job: job 2022-01-24_03_14_43-10625602788189603585 failed
panic: Failed to execute job: job 2022-01-24_03_14_43-10625602788189603585 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144b88, 0xc000198000, 0x1033693, 0x19, 0xc0004addf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jl3m6kskgpfgg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #399

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/399/display/redirect>

Changes:


------------------------------------------
[...truncated 18.37 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/23 11:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642936483339032126/model
2022/01/23 11:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0123100339"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642936483339032126/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642936483339032126/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0123100339",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/23 11:14:46 Submitted job: 2022-01-23_03_14_45-5498072255354283492
2022/01/23 11:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-23_03_14_45-5498072255354283492?project=apache-beam-testing
2022/01/23 11:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-23_03_14_45-5498072255354283492
2022/01/23 11:14:46 Job state: JOB_STATE_PENDING ...
2022/01/23 11:15:16 Job still running ...
2022/01/23 11:15:46 Job still running ...
2022/01/23 11:16:16 Job still running ...
2022/01/23 11:16:46 Job still running ...
2022/01/23 11:17:16 Job still running ...
2022/01/23 11:17:46 Job still running ...
2022/01/23 11:18:16 Failed to execute job: job 2022-01-23_03_14_45-5498072255354283492 failed
panic: Failed to execute job: job 2022-01-23_03_14_45-5498072255354283492 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144b88, 0xc0000480b0, 0x1033693, 0x19, 0xc00014bdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/72obasfjtlfnc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #398

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/398/display/redirect?page=changes>

Changes:

[ningkang0957] [BEAM-13687] Improved Spanner IO request count metrics

[noreply] [BEAM-10206] Add key for fields in wrapper (#16583)

[noreply] Merge pull request #16530 from Adding JSON support in SpannerIO and

[noreply] [BEAM-13685] Enable users to specify cache directory under Interactive


------------------------------------------
[...truncated 18.37 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/22 11:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642850086637455784/model
2022/01/22 11:14:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0122100357"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642850086637455784/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642850086637455784/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0122100357",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/22 11:14:48 Submitted job: 2022-01-22_03_14_47-11783664901404319678
2022/01/22 11:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-22_03_14_47-11783664901404319678?project=apache-beam-testing
2022/01/22 11:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-22_03_14_47-11783664901404319678
2022/01/22 11:14:48 Job state: JOB_STATE_PENDING ...
2022/01/22 11:15:18 Job still running ...
2022/01/22 11:15:48 Job still running ...
2022/01/22 11:16:18 Job still running ...
2022/01/22 11:16:48 Job still running ...
2022/01/22 11:17:18 Job still running ...
2022/01/22 11:17:48 Job still running ...
2022/01/22 11:18:18 Failed to execute job: job 2022-01-22_03_14_47-11783664901404319678 failed
panic: Failed to execute job: job 2022-01-22_03_14_47-11783664901404319678 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144b88, 0xc0000480b0, 0x1033693, 0x19, 0xc000029df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 56s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ckmyomfl2mheo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #397

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/397/display/redirect?page=changes>

Changes:

[thiagotnunes] [BEAM-12164]: Add SDF for reading change stream records

[tuyarer] [BEAM-13577] Beam Select's uniquifyNames function loses nullability of

[sergey.kalinin] Update GH Actions to use proper variables names and proper triggers

[dhuntsperger] edited README and comments in Python multi-lang pipes examples

[Pablo Estrada] Revert "Merge pull request #15863 from [BEAM-13184] Autosharding for

[Pablo Estrada] BEAM-13611 reactivating jdbcio xlang test

[Steve Niemitz] [BEAM-13689] Output token elements when BQ batch writes complete.

[noreply] Merge pull request #16371 from [BEAM-13518][Playground] Beam Playground

[noreply] Update Java FnAPI beam master (#16572)

[noreply] [BEAM-13699] Replace fnv with maphash. (#16573)

[noreply] [BEAM-13693] Bump

[noreply] [BEAM-10206] Remove Fatalf calls in non-test goroutines for

[noreply] [BEAM-13430] Re-add provided configuration (#16552)

[noreply] Merge pull request #16540 from [BEAM-13678][Playground]Update Github

[noreply] Merge pull request #16546 from [BEAM-13661] [BEAM-13704] [Playground]

[noreply] Merge pull request #16369 from [BEAM-13558] [Playground] Hide the Graph


------------------------------------------
[...truncated 18.39 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/21 11:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642763685220575213/model
2022/01/21 11:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0121100340"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642763685220575213/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642763685220575213/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0121100340",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/21 11:14:49 Submitted job: 2022-01-21_03_14_45-4883994788667096833
2022/01/21 11:14:49 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-21_03_14_45-4883994788667096833?project=apache-beam-testing
2022/01/21 11:14:49 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-21_03_14_45-4883994788667096833
2022/01/21 11:14:49 Job state: JOB_STATE_PENDING ...
2022/01/21 11:15:19 Job still running ...
2022/01/21 11:15:49 Job still running ...
2022/01/21 11:16:19 Job still running ...
2022/01/21 11:16:49 Job still running ...
2022/01/21 11:17:19 Job still running ...
2022/01/21 11:17:49 Job still running ...
2022/01/21 11:18:19 Failed to execute job: job 2022-01-21_03_14_45-4883994788667096833 failed
panic: Failed to execute job: job 2022-01-21_03_14_45-4883994788667096833 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1144b88, 0xc0000480b0, 0x1033693, 0x19, 0xc00044bdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 57s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/3h3ajfxa72pyg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #396

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/396/display/redirect?page=changes>

Changes:

[noreply] [BEAM-13015] Provide caching statistics in the status client. (#16495)

[noreply] [BEAM-13611] Skip test_xlang_jdbc_write (#16554)

[noreply] Merge pull request #16370 from [BEAM-13556] playground - color and

[noreply] Merge pull request #16531 from [BEAM-13567] [playground] Handle run code

[noreply] Merge pull request #16533 from [BEAM-13548] [Playground] Add example

[noreply] Merge pull request #16519 from [BEAM-13639] [Playground] Add

[noreply] Merge pull request #16518 from [BEAM-13619] [Playground] Add loading

[noreply] Merge pull request #16243 from

[noreply] [BEAM-13683] Make cross-language SQL example pipeline (#16567)

[noreply] [BEAM-13688] fixed type in BPG 4.5.3 window section (#16560)

[noreply] Remove obsolete commands from Inventory job. (#16564)

[noreply] Disable logging for memoization test. (#16556)

[noreply] Merge pull request #16472: [BEAM-13697] Add SchemaFieldNumber annotation

[noreply] Merge pull request #16373 from [BEAM-13515] [Playground] Hiding lines in


------------------------------------------
[...truncated 18.39 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/20 11:14:51 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642677290421925657/model
2022/01/20 11:14:51 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0120100342"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642677290421925657/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642677290421925657/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0120100342",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/20 11:14:52 Submitted job: 2022-01-20_03_14_51-18064214924336374037
2022/01/20 11:14:52 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-20_03_14_51-18064214924336374037?project=apache-beam-testing
2022/01/20 11:14:52 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-20_03_14_51-18064214924336374037
2022/01/20 11:14:52 Job state: JOB_STATE_PENDING ...
2022/01/20 11:15:22 Job still running ...
2022/01/20 11:15:52 Job still running ...
2022/01/20 11:16:22 Job still running ...
2022/01/20 11:16:53 Job still running ...
2022/01/20 11:17:23 Job still running ...
2022/01/20 11:17:53 Job still running ...
2022/01/20 11:18:23 Failed to execute job: job 2022-01-20_03_14_51-18064214924336374037 failed
panic: Failed to execute job: job 2022-01-20_03_14_51-18064214924336374037 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11436a8, 0xc000120000, 0x1032253, 0x19, 0xc0005c7df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 4m 2s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5c2do7o24pxjq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #395

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/395/display/redirect?page=changes>

Changes:

[mmack] [BEAM-8806] Integration test for SqsIO

[Robert Bradshaw] Bump beam container version.

[alexander.zhuravlev] [BEAM-13680] Fixed code_repository (added pipelineUuid to RunCodeResult

[Robert Bradshaw] Also bump FnAPI container.

[noreply] [BEAM-13616][BEAM-13645] Switch to vendored grpc 1.43.2 (#16543)

[noreply] [BEAM-13616][BEAM-13646] Upgrade vendored calcite to 1.28.0:0.2 (#16544)

[noreply] Merge pull request #16486 from [BEAM-13544][Playground] Add logs to

[noreply] [BEAM-13683] Correct SQL transform schema, fix expansion address

[noreply] Update walkthrough.md (#16512)

[noreply] [BEAM-11808][BEAM-9879] Support aggregate functions with two arguments

[noreply] Merge pull request #16506 from [BEAM-13652][Playground] Send examples'

[noreply] Merge pull request #16322 from [BEAM-13407] [Playground] Preload fonts

[noreply] [BEAM-13665] Make SpannerIO projectID optional again (#16547)

[noreply] [BEAM-13015] Add state caching capability to be used as hint for runners

[noreply] Merge pull request #16309: [BEAM-13503] Set a default value to


------------------------------------------
[...truncated 18.39 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/19 11:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642590879298976575/model
2022/01/19 11:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0119100400"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642590879298976575/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642590879298976575/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0119100400",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/19 11:14:40 Submitted job: 2022-01-19_03_14_39-12114297071053782385
2022/01/19 11:14:40 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-19_03_14_39-12114297071053782385?project=apache-beam-testing
2022/01/19 11:14:40 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-19_03_14_39-12114297071053782385
2022/01/19 11:14:40 Job state: JOB_STATE_PENDING ...
2022/01/19 11:15:10 Job still running ...
2022/01/19 11:15:40 Job still running ...
2022/01/19 11:16:10 Job still running ...
2022/01/19 11:16:40 Job still running ...
2022/01/19 11:17:10 Job still running ...
2022/01/19 11:17:40 Job still running ...
2022/01/19 11:18:10 Failed to execute job: job 2022-01-19_03_14_39-12114297071053782385 failed
panic: Failed to execute job: job 2022-01-19_03_14_39-12114297071053782385 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11436a8, 0xc0000480b0, 0x1032253, 0x19, 0xc000227df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 49s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/etpe2j3wu5qjc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #394

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/394/display/redirect?page=changes>

Changes:

[mmack] [BEAM-13631] Add deterministic SQS message coder to fix reading from SQS

[aydar.zaynutdinov] [BEAM-13641][Playground]

[noreply] Remove jcenter repositories from gradle configuration. (#16532)

[noreply] [BEAM-13430] Remove jcenter which will no longer contain any updates.

[noreply] [BEAM-13616] Update com.google.cloud:libraries-bom to 24.2.0 (#16509)


------------------------------------------
[...truncated 18.35 KB...]
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/18 11:14:34 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642504474185448133/model
2022/01/18 11:14:34 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0118100352"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642504474185448133/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642504474185448133/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0118100352",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/18 11:14:35 Submitted job: 2022-01-18_03_14_34-10083270566648234254
2022/01/18 11:14:35 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-18_03_14_34-10083270566648234254?project=apache-beam-testing
2022/01/18 11:14:35 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-18_03_14_34-10083270566648234254
2022/01/18 11:14:35 Job state: JOB_STATE_PENDING ...
2022/01/18 11:15:05 Job still running ...
2022/01/18 11:15:35 Job still running ...
2022/01/18 11:16:05 Job still running ...
2022/01/18 11:16:35 Job still running ...
2022/01/18 11:17:05 Job still running ...
2022/01/18 11:17:35 Job still running ...
2022/01/18 11:18:05 Failed to execute job: job 2022-01-18_03_14_34-10083270566648234254 failed
panic: Failed to execute job: job 2022-01-18_03_14_34-10083270566648234254 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11436a8, 0xc0000480b0, 0x1032253, 0x19, 0xc000353df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 3m 43s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://scans.gradle.com/s/z5iozhnldyplk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #393

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/393/display/redirect?page=changes>

Changes:

[mmack] [BEAM-8806] Integration test for SqsIO using Localstack

[noreply] Merge pull request #16507: [BEAM-13137] Fixes ES utest size flakiness


------------------------------------------
[...truncated 18.50 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/17 11:14:37 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642418076803146824/model
2022/01/17 11:14:37 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0117100359"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642418076803146824/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642418076803146824/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0117100359",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/17 11:14:38 Submitted job: 2022-01-17_03_14_37-18339267100442525448
2022/01/17 11:14:38 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-17_03_14_37-18339267100442525448?project=apache-beam-testing
2022/01/17 11:14:38 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-17_03_14_37-18339267100442525448
2022/01/17 11:14:38 Job state: JOB_STATE_PENDING ...
2022/01/17 11:15:08 Job still running ...
2022/01/17 11:15:38 Job still running ...
2022/01/17 11:16:08 Job still running ...
2022/01/17 11:16:38 Job still running ...
2022/01/17 11:17:08 Job still running ...
2022/01/17 11:17:38 Job still running ...
2022/01/17 11:18:08 Failed to execute job: job 2022-01-17_03_14_37-18339267100442525448 failed
panic: Failed to execute job: job 2022-01-17_03_14_37-18339267100442525448 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11436a8, 0xc0000480b0, 0x1032253, 0x19, 0xc00026fdf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 47s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://scans.gradle.com/s/nunpceurtvo3k

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #392

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/392/display/redirect>

Changes:


------------------------------------------
[...truncated 18.46 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/16 11:14:50 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642331690382727085/model
2022/01/16 11:14:50 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0116100343"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642331690382727085/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642331690382727085/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0116100343",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/16 11:14:51 Submitted job: 2022-01-16_03_14_50-2072202967748414887
2022/01/16 11:14:51 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-16_03_14_50-2072202967748414887?project=apache-beam-testing
2022/01/16 11:14:51 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-16_03_14_50-2072202967748414887
2022/01/16 11:14:51 Job state: JOB_STATE_PENDING ...
2022/01/16 11:15:21 Job still running ...
2022/01/16 11:15:52 Job still running ...
2022/01/16 11:16:22 Job still running ...
2022/01/16 11:16:52 Job still running ...
2022/01/16 11:17:22 Job still running ...
2022/01/16 11:17:52 Job still running ...
2022/01/16 11:18:22 Failed to execute job: job 2022-01-16_03_14_50-2072202967748414887 failed
panic: Failed to execute job: job 2022-01-16_03_14_50-2072202967748414887 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11436a8, 0xc000120000, 0x1032253, 0x19, 0xc00034ddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://scans.gradle.com/s/acmbzjep4nyhk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #391

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/391/display/redirect?page=changes>

Changes:

[daria.malkova] Split builder into several builder for each step of pipeline execution

[Valentyn Tymofieiev] Provide API to check whether a hint is known.

[Valentyn Tymofieiev] [BEAM-12558] Fix doc typo.

[arietis27] [BEAM-13400] JDBC IO does not support UUID and JSONB PostgreSQL types

[jrmccluskey] [BEAM-10206] Resolve go vet errors in protox package

[noreply] Merge pull request #16482 from [BEAM-13429][Playground] Add builder for

[noreply] [BEAM-13590] Fix  abc imports from collections (#15850)

[jrmccluskey] Fix staticcheck errors in transforms directory

[jrmccluskey] Remove unnecessary fmt.Sprintf() in partition.go

[jrmccluskey] Replace bytes.Compare() with bytes.Equal() in test cases

[jrmccluskey] Replace string(buf.Bytes()) with buf.String() in coder_test.go

[jrmccluskey] Remove unnecessary blank identifier assignment in harness.go

[jrmccluskey] fix capitalized error strings in expansionx

[jrmccluskey] Clean up string cast of bytes in vet.go and corresponding tests

[jrmccluskey] Remove unnecessary fmt call in universal.go

[Robert Bradshaw] Remove tab from source.

[noreply] Redirecting cross-language transforms content (#16504)

[noreply] doc tweaks (#16498)

[noreply] [BEAM-12621] - Update Jenkins VMs to modern Ubuntu version (#16457)

[noreply] [BEAM-13664] Fix Primitives hashing benchmark (#16523)


------------------------------------------
[...truncated 18.46 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/15 11:14:39 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642245278456012333/model
2022/01/15 11:14:39 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0115100354"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642245278456012333/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642245278456012333/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0115100354",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/15 11:14:39 Submitted job: 2022-01-15_03_14_39-16953086146932247996
2022/01/15 11:14:39 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-15_03_14_39-16953086146932247996?project=apache-beam-testing
2022/01/15 11:14:39 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-15_03_14_39-16953086146932247996
2022/01/15 11:14:39 Job state: JOB_STATE_PENDING ...
2022/01/15 11:15:09 Job still running ...
2022/01/15 11:15:39 Job still running ...
2022/01/15 11:16:09 Job still running ...
2022/01/15 11:16:40 Job still running ...
2022/01/15 11:17:10 Job still running ...
2022/01/15 11:17:40 Job still running ...
2022/01/15 11:18:10 Failed to execute job: job 2022-01-15_03_14_39-16953086146932247996 failed
panic: Failed to execute job: job 2022-01-15_03_14_39-16953086146932247996 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11436a8, 0xc0000480b0, 0x1032253, 0x19, 0xc0003f7df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 48s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://scans.gradle.com/s/xkr4ozj45cktg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #390

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/390/display/redirect?page=changes>

Changes:

[blais] python sdk examples: Fixed typo in wordcount example.

[noreply] [BEAM-13480] Increase pipeline timeout for

[noreply] Stronger typing inference for CoGBK. (#16465)

[noreply] [BEAM-12464] Change ProtoSchemaTranslator beam schema creation to match

[noreply] Introduce the notion of a JoinIndex for fewer shuffles. (#16101)

[noreply] Merge pull request #16467 from [BEAM-12164]: SpannerIO

[noreply] Merge pull request #16385 from [BEAM-13535] [Playground] add cancel

[noreply] Merge pull request #16485 from [BEAM-13486] [Playground] For unit tests

[heejong] [BEAM-13455] Remove duplicated artifacts when using multiple

[noreply] [BEAM-12572] Run java examples on multiple runners (#16450)


------------------------------------------
[...truncated 18.47 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/14 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642158880704998104/model
2022/01/14 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0114100357"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642158880704998104/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642158880704998104/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0114100357",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/14 11:14:41 Submitted job: 2022-01-14_03_14_41-8997935692900524762
2022/01/14 11:14:41 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-14_03_14_41-8997935692900524762?project=apache-beam-testing
2022/01/14 11:14:41 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-14_03_14_41-8997935692900524762
2022/01/14 11:14:42 Job state: JOB_STATE_PENDING ...
2022/01/14 11:15:12 Job still running ...
2022/01/14 11:15:42 Job still running ...
2022/01/14 11:16:12 Job still running ...
2022/01/14 11:16:42 Job still running ...
2022/01/14 11:17:12 Job still running ...
2022/01/14 11:17:42 Job still running ...
2022/01/14 11:18:12 Failed to execute job: job 2022-01-14_03_14_41-8997935692900524762 failed
panic: Failed to execute job: job 2022-01-14_03_14_41-8997935692900524762 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11436a8, 0xc0000480b0, 0x1032253, 0x19, 0xc0001d5df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 50s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/74nsse6uxggse

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #389

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/389/display/redirect?page=changes>

Changes:

[mmack] [BEAM-13638] Datatype of timestamp fields in SqsMessage for AWS IOs for

[noreply] Merge pull request #16469 from [BEAM-13623][Playground] [Bugfix] During

[noreply] Merge pull request #16149 from [BEAM-13113] [Playground] playground

[noreply] Merge pull request #16363 from [BEAM-13557] [Playground] show code

[noreply] Merge pull request #16374 from [BEAM-13398][Playground] Split LifeCycle

[noreply] [BEAM-13616][BEAM-13646] Update vendored calcite 1.28.0 with protobuf

[chamikaramj] Adds several example multi-language Python pipelines

[noreply] Merge pull request #16325 from [BEAM-13471] [Playground] Tag existing

[noreply] [BEAM-13399] Move service liveness polling to Runner type (#16487)


------------------------------------------
[...truncated 18.47 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/13 11:14:41 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1642072480599768646/model
2022/01/13 11:14:41 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0113100350"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642072480599768646/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1642072480599768646/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0113100350",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/13 11:14:43 Submitted job: 2022-01-13_03_14_41-15096162432228854254
2022/01/13 11:14:43 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-13_03_14_41-15096162432228854254?project=apache-beam-testing
2022/01/13 11:14:43 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-13_03_14_41-15096162432228854254
2022/01/13 11:14:43 Job state: JOB_STATE_PENDING ...
2022/01/13 11:15:13 Job still running ...
2022/01/13 11:15:43 Job still running ...
2022/01/13 11:16:13 Job still running ...
2022/01/13 11:16:43 Job still running ...
2022/01/13 11:17:14 Job still running ...
2022/01/13 11:17:44 Job still running ...
2022/01/13 11:18:14 Failed to execute job: job 2022-01-13_03_14_41-15096162432228854254 failed
panic: Failed to execute job: job 2022-01-13_03_14_41-15096162432228854254 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11436a8, 0xc000120000, 0x1032253, 0x19, 0xc0002d9df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 52s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6jdbqlm2bqld2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #388

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/388/display/redirect?page=changes>

Changes:

[ningkang0957] [BEAM-13602] Prevented metrics gathering from failing bigtable io

[ningkang0957] make the code more pythonic

[mmack] [BEAM-13243][BEAM-8374] Add support for missing PublishResponse fields

[Robert Bradshaw] Optional args and kwargs for named external transforms.

[mmack] [adhoc] Run spotlessApply on java examples to fix master

[noreply] [BEAM-13628] Update SideInputCache to use full Transform and

[noreply] [BEAM-13432] Skip ExpansionService creation in Job Server (#16222)

[noreply] [BEAM-13616] Initial files for vendored gRPC 1.43.2 (#16460)


------------------------------------------
[...truncated 18.47 KB...]
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e5"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/12 11:14:44 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641986084088917392/model
2022/01/12 11:14:44 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0112100340"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641986084088917392/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641986084088917392/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0112100340",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/12 11:14:45 Submitted job: 2022-01-12_03_14_44-15653252310584330420
2022/01/12 11:14:45 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-12_03_14_44-15653252310584330420?project=apache-beam-testing
2022/01/12 11:14:45 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-12_03_14_44-15653252310584330420
2022/01/12 11:14:45 Job state: JOB_STATE_PENDING ...
2022/01/12 11:15:15 Job still running ...
2022/01/12 11:15:45 Job still running ...
2022/01/12 11:16:15 Job still running ...
2022/01/12 11:16:45 Job still running ...
2022/01/12 11:17:15 Job still running ...
2022/01/12 11:17:46 Job still running ...
2022/01/12 11:18:16 Job still running ...
2022/01/12 11:18:46 Failed to execute job: job 2022-01-12_03_14_44-15653252310584330420 failed
panic: Failed to execute job: job 2022-01-12_03_14_44-15653252310584330420 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x11436a8, 0xc0000480b0, 0x1032253, 0x19, 0xc0003fddf0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 23s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bfj6i2xnyezrk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #387

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/387/display/redirect?page=changes>

Changes:

[relax] don't close streams in finalize

[noreply] Loosen typing extensions bound

[Alexey Romanenko] [BEAM-4868] Bump com.amazonaws to 1.12.135

[noreply] [BEAM-12092] Bump jedis to version 4.0.1 (#16287)

[noreply] [BEAM-13534] Add automated port polling to expansion service runner if

[noreply] Merge pull request #16344 from [BEAM-13536][Playground][Bugfix] CI step

[noreply] Merge pull request #16359 from [BEAM-13545][Playground] Add

[noreply] Merge pull request #16384 from [BEAM-13308] [Playground] Getting

[noreply] Merge pull request #16306 from [BEAM-13447] [Playground] Add filling of

[noreply] Merge pull request #16361 from [BEAM-13543][Playground] Add logic of

[noreply] [BEAM-12562] Dataframe pipe implementation (#16256)

[noreply] Merge pull request #16338 from [BEAM-13528][Playground] Add liveness

[noreply] [BEAM-13626] Remap expanded outputs after merging. (#16471)

[noreply] Merge pull request #16147 from [BEAM-13359] [Playground] Tag existing

[noreply] [BEAM-3221] Improve documentation in model pipeline protos (#16474)

[noreply] [BEAM-13614] Add OnWindowExpiration support to the Java SDK harness and

[noreply] Merge pull request #16156 from [BEAM-13391] Fix temporary file format in


------------------------------------------
[...truncated 18.49 KB...]
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/11 11:14:45 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641899684757602344/model
2022/01/11 11:14:45 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0111100340"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641899684757602344/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641899684757602344/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0111100340",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/11 11:14:46 Submitted job: 2022-01-11_03_14_45-8562131621321583516
2022/01/11 11:14:46 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-11_03_14_45-8562131621321583516?project=apache-beam-testing
2022/01/11 11:14:46 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-11_03_14_45-8562131621321583516
2022/01/11 11:14:46 Job state: JOB_STATE_PENDING ...
2022/01/11 11:15:16 Job still running ...
2022/01/11 11:15:46 Job still running ...
2022/01/11 11:16:16 Job still running ...
2022/01/11 11:16:46 Job still running ...
2022/01/11 11:17:16 Job still running ...
2022/01/11 11:17:46 Job still running ...
2022/01/11 11:18:16 Job still running ...
2022/01/11 11:18:46 Job still running ...
2022/01/11 11:19:16 Job still running ...
2022/01/11 11:19:46 Job still running ...
2022/01/11 11:20:16 Failed to execute job: job 2022-01-11_03_14_45-8562131621321583516 failed
panic: Failed to execute job: job 2022-01-11_03_14_45-8562131621321583516 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143348, 0xc0000480b0, 0x1032053, 0x19, 0xc000409df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 5m 54s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/nimstvg23nlrs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #386

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/386/display/redirect?page=changes>

Changes:

[Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.106


------------------------------------------
[...truncated 18.51 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/10 11:14:47 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641813287287776572/model
2022/01/10 11:14:47 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0110100336"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641813287287776572/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641813287287776572/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0110100336",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/10 11:14:48 Submitted job: 2022-01-10_03_14_47-5041236501005414031
2022/01/10 11:14:48 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-10_03_14_47-5041236501005414031?project=apache-beam-testing
2022/01/10 11:14:48 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-10_03_14_47-5041236501005414031
2022/01/10 11:14:48 Job state: JOB_STATE_PENDING ...
2022/01/10 11:15:18 Job still running ...
2022/01/10 11:15:48 Job still running ...
2022/01/10 11:16:18 Job still running ...
2022/01/10 11:16:49 Job still running ...
2022/01/10 11:17:19 Job still running ...
2022/01/10 11:17:49 Job still running ...
2022/01/10 11:18:19 Failed to execute job: job 2022-01-10_03_14_47-5041236501005414031 failed
panic: Failed to execute job: job 2022-01-10_03_14_47-5041236501005414031 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143348, 0xc0000480b0, 0x1032053, 0x19, 0xc0004e9df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 58s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/3c3u5m3asslp6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_LoadTests_Go_SideInput_Dataflow_Batch #385

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/385/display/redirect>

Changes:


------------------------------------------
[...truncated 18.46 KB...]
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\035apache/beam_go_sdk:2.37.0.dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      capabilities: "beam:coder:row:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_****_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006****"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "e4"
root_transform_ids: "e6_keyed1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
requirements: "beam:requirement:pardo:splittable_dofn:v1"
2022/01/09 11:14:35 Staged model pipeline: gs://temp-storage-for-perf-tests/loadtests/go-1-1641726874874866017/model
2022/01/09 11:14:35 {
  "environment": {
    "experiments": [
      "use_unified_****",
      "use_portable_job_submission",
      "beam_fn_api"
    ],
    "sdkPipelineOptions": {
      "display_data": [
        {
          "key": "name",
          "namespace": "options",
          "type": "STRING",
          "value": "load-tests-go-dataflow-batch-sideinput-3-0109100354"
        },
        {
          "key": "experiments",
          "namespace": "options",
          "type": "STRING",
          "value": "use_unified_****,use_portable_job_submission"
        },
        {
          "key": "project",
          "namespace": "options",
          "type": "STRING",
          "value": "apache-beam-testing"
        },
        {
          "key": "region",
          "namespace": "options",
          "type": "STRING",
          "value": "us-central1"
        },
        {
          "key": "container_images",
          "namespace": "options",
          "type": "STRING",
          "value": "apache/beam_go_sdk:2.37.0.dev"
        },
        {
          "key": "temp_location",
          "namespace": "options",
          "type": "STRING",
          "value": "gs://temp-storage-for-perf-tests/loadtests"
        },
        {
          "key": "influx_namespace",
          "namespace": "go_options",
          "type": "STRING",
          "value": "dataflow"
        },
        {
          "key": "input_options",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}"
        },
        {
          "key": "hookOrder",
          "namespace": "go_options",
          "type": "STRING",
          "value": "[\"default_remote_logging\"]"
        },
        {
          "key": "access_percentage",
          "namespace": "go_options",
          "type": "STRING",
          "value": "1"
        },
        {
          "key": "influx_db_name",
          "namespace": "go_options",
          "type": "STRING",
          "value": "beam_test_metrics"
        },
        {
          "key": "influx_hostname",
          "namespace": "go_options",
          "type": "STRING",
          "value": "http://10.128.0.96:8086"
        },
        {
          "key": "influx_measurement",
          "namespace": "go_options",
          "type": "STRING",
          "value": "go_batch_sideinput_3"
        },
        {
          "key": "****_binary",
          "namespace": "go_options",
          "type": "STRING",
          "value": "linux_amd64/sideinput"
        },
        {
          "key": "hooks",
          "namespace": "go_options",
          "type": "STRING",
          "value": "{\"default_remote_logging\":null}"
        }
      ],
      "options": {
        "experiments": [
          "use_unified_****",
          "use_portable_job_submission",
          "beam_fn_api"
        ],
        "pipelineUrl": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641726874874866017/model",
        "region": "us-central1",
        "tempLocation": "gs://temp-storage-for-perf-tests/loadtests"
      },
      "beam:option:go_options:v1": {
        "options": {
          "access_percentage": "1",
          "hookOrder": "[\"default_remote_logging\"]",
          "hooks": "{\"default_remote_logging\":null}",
          "influx_db_name": "beam_test_metrics",
          "influx_hostname": "http://10.128.0.96:8086",
          "influx_measurement": "go_batch_sideinput_3",
          "influx_namespace": "dataflow",
          "input_options": "{\"num_records\": 400000,\"key_size\": 100,\"value_size\": 900}",
          "****_binary": "linux_amd64/sideinput"
        }
      }
    },
    "tempStoragePrefix": "gs://temp-storage-for-perf-tests/loadtests",
    "userAgent": {
      "name": "Apache Beam SDK for Go",
      "version": "2.37.0.dev"
    },
    "version": {
      "job_type": "FNAPI_BATCH",
      "major": "6"
    },
    "****Pools": [
      {
        "autoscalingSettings": {
          "algorithm": "AUTOSCALING_ALGORITHM_NONE"
        },
        "ipConfiguration": "WORKER_IP_UNSPECIFIED",
        "kind": "harness",
        "numWorkers": 10,
        "packages": [
          {
            "location": "gs://temp-storage-for-perf-tests/loadtests/go-1-1641726874874866017/****",
            "name": "****"
          }
        ],
        "sdkHarnessContainerImages": [
          {
            "containerImage": "apache/beam_go_sdk:2.37.0.dev"
          }
        ],
        "****HarnessContainerImage": "apache/beam_go_sdk:2.37.0.dev"
      }
    ]
  },
  "name": "load-tests-go-dataflow-batch-sideinput-3-0109100354",
  "projectId": "apache-beam-testing",
  "type": "JOB_TYPE_BATCH"
}
2022/01/09 11:14:36 Submitted job: 2022-01-09_03_14_35-12092377195890341384
2022/01/09 11:14:36 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-01-09_03_14_35-12092377195890341384?project=apache-beam-testing
2022/01/09 11:14:36 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-01-09_03_14_35-12092377195890341384
2022/01/09 11:14:36 Job state: JOB_STATE_PENDING ...
2022/01/09 11:15:06 Job still running ...
2022/01/09 11:15:36 Job still running ...
2022/01/09 11:16:06 Job still running ...
2022/01/09 11:16:36 Job still running ...
2022/01/09 11:17:06 Job still running ...
2022/01/09 11:17:36 Job still running ...
2022/01/09 11:18:06 Failed to execute job: job 2022-01-09_03_14_35-12092377195890341384 failed
panic: Failed to execute job: job 2022-01-09_03_14_35-12092377195890341384 failed

goroutine 1 [running]:
github.com/apache/beam/sdks/v2/go/pkg/beam/log.Fatalf(0x1143348, 0xc0000480b0, 0x1032053, 0x19, 0xc0002c9df0, 0x1, 0x1)
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/pkg/beam/log/log.go>:153 +0xec
main.main()
	<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/sideinput/sideinput.go>:93 +0x474

> Task :sdks:go:test:load:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Go_SideInput_Dataflow_Batch/ws/src/sdks/go/test/load/build.gradle'> line: 31

* What went wrong:
Execution failed for task ':sdks:go:test:load:run'.
> Process 'command 'sh'' finished with non-zero exit value 2

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 46s
12 actionable tasks: 6 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/w3wlsyg73fpdg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org