You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/01/10 11:35:32 UTC
Build failed in Jenkins: beam_PerformanceTests_TextIOIT #1
See <https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/1/display/redirect>
------------------------------------------
[...truncated 55.12 KB...]
2018-01-10 11:28:49,664 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:28:49,664 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:29:05,536 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:29:06,807 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:29:06,807 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:29:33,601 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:29:34,170 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:29:34,170 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:29:54,373 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:29:55,195 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:29:55,196 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:30:20,279 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:30:20,858 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:30:20,858 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:30:49,851 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:30:50,445 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:30:50,445 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:31:17,514 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:31:18,331 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:31:18,331 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:31:40,388 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:31:41,141 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:31:41,142 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:32:05,858 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:32:06,558 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:32:06,559 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:32:29,989 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:32:30,716 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:32:30,716 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:32:54,102 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:32:54,677 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:32:54,678 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:33:13,798 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:33:14,319 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:33:14,320 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:33:38,245 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:33:38,890 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:33:38,890 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:34:02,540 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:34:03,249 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:34:03,249 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:34:24,276 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:34:24,959 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:34:24,959 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:34:47,600 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:34:48,217 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:34:48,218 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:35:13,879 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:35:14,503 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
2018-01-10 11:35:14,503 129d9fb2 MainThread INFO Retrying exception running IssueRetryableCommand: Command returned a non-zero exit code.
2018-01-10 11:35:30,999 129d9fb2 MainThread INFO Running: bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json
2018-01-10 11:35:31,680 129d9fb2 MainThread INFO Ran bq load --source_format=NEWLINE_DELIMITED_JSON beam_performance.textioit_pkb_results /tmp/perfkitbenchmarker/runs/129d9fb2/perfkit-bq-pub5iD79s.json. Got return code (1).
STDOUT: BigQuery error in load operation: No schema specified on job or table.
STDERR: /usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73: UserWarning: You have requested explicit scopes to be used with a GCE service account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.
warnings.warn(_SCOPES_WARNING)
Traceback (most recent call last):
File "PerfKitBenchmarker/pkb.py", line 21, in <module>
sys.exit(Main())
File "<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 870, in Main
return RunBenchmarks()
File "<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 797, in RunBenchmarks
collector.PublishSamples()
File "<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",> line 878, in PublishSamples
publisher.PublishSamples(self.samples)
File "<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/publisher.py",> line 530, in PublishSamples
vm_util.IssueRetryableCommand(load_cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 247, in WrappedFunction
return f(*args, **kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 364, in IssueRetryableCommand
'Command returned a non-zero exit code.\n')
perfkitbenchmarker.errors.CalledProcessException: Command returned a non-zero exit code.
Build step 'Execute shell' marked build as failure
Jenkins build is back to normal : beam_PerformanceTests_TextIOIT #3
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/3/display/redirect>
Build failed in Jenkins: beam_PerformanceTests_TextIOIT #2
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/2/display/redirect>
------------------------------------------
GitHub pull request #4378 of commit 55ecb8208cae416bcfcfd6aa007a7419ce9ca007, no merge conflicts.
Setting status of 55ecb8208cae416bcfcfd6aa007a7419ce9ca007 to PENDING with url https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/2/ and message: 'Build started sha1 is merged.'
Using context: Jenkins: Java TextIO Performance Test
[EnvInject] - Loading node environment variables.
Building remotely on beam2 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/4378/*:refs/remotes/origin/pr/4378/*
> git rev-parse refs/remotes/origin/pr/4378/merge^{commit} # timeout=10
> git rev-parse refs/remotes/origin/origin/pr/4378/merge^{commit} # timeout=10
Checking out Revision 1748e6f0303080afebc3d28877c3be6d2f883e47 (refs/remotes/origin/pr/4378/merge)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1748e6f0303080afebc3d28877c3be6d2f883e47
Commit message: "Merge 55ecb8208cae416bcfcfd6aa007a7419ce9ca007 into 0d4e736468bb06d031c78ce41a6973554aecc27f"
First time build. Skipping changelog.
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins3767574214014524643.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins8106472596241210172.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins8726126529127569131.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied: numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
[beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins782200181605536253.sh
+ pip install --user -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: grpcio<2,>=1.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: hdfs3<0.4.0,>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.3.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio<2,>=1.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.3.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.3.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.3.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.3.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.3.0.dev0)
Requirement already satisfied: setuptools in /usr/local/lib/python2.7/dist-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.3.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.3.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.3.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1[grpc]<0.16dev,>=0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: requests<3.0dev,>=2.13.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests<3.0dev,>=2.13.0->google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.3.0.dev0)
Installing collected packages: apache-beam
Found existing installation: apache-beam 2.3.0.dev0
Uninstalling apache-beam-2.3.0.dev0:
Successfully uninstalled apache-beam-2.3.0.dev0
Running setup.py develop for apache-beam
Successfully installed apache-beam
[beam_PerformanceTests_TextIOIT] $ /bin/bash -xe /tmp/jenkins3281563496732469078.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.textioit_pkb_results --official=true --benchmarks=beam_integration_benchmark --beam_it_timeout=1200 --beam_it_profile=io-it --beam_prebuilt=true --beam_sdk=java --beam_it_module=sdks/java/io/file-based-io-tests --beam_it_class=org.apache.beam.sdk.io.text.TextIOIT '--beam_it_options=[--project=apache-beam-testing,--tempRoot=gs://temp-storage-for-perf-tests,--numberOfRecords=1000000,--filenamePrefix=gs://temp-storage-for-perf-tests/beam_PerformanceTests_TextIOIT/2/]' '--beam_extra_mvn_properties=[filesystem=gcs]'
Traceback (most recent call last):
File "PerfKitBenchmarker/pkb.py", line 21, in <module>
sys.exit(Main())
File "<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 869, in Main
SetUpPKB()
File "<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 740, in SetUpPKB
vm_util.GenTempDir()
File "<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 121, in GenTempDir
temp_dir.CreateTemporaryDirectories()
File "<https://builds.apache.org/job/beam_PerformanceTests_TextIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py",> line 62, in CreateTemporaryDirectories
os.makedirs(path)
File "/usr/lib/python2.7/os.py", line 157, in makedirs
mkdir(name, mode)
OSError: [Errno 13] Permission denied: '/tmp/perfkitbenchmarker/runs/ad47f695'
Build step 'Execute shell' marked build as failure