You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/06/19 17:15:13 UTC
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #2
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/2/display/redirect>
------------------------------------------
[...truncated 222.09 KB...]
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00000-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00020-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00010-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
]}
Jun 19, 2018 5:15:07 PM org.apache.beam.sdk.util.MutationDetectors$CodedValueMutationDetector verifyUnmodifiedThrowingCheckedExceptions
WARNING: Coder of type class org.apache.beam.sdk.coders.KvCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element KV{null, [2015-07-15T00:00:09.999Z shard-00014-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00011-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00003-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00004-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00023-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00013-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00022-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00019-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00008-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00017-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00016-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00012-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00006-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00009-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00018-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00007-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00000-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00020-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00010-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
]}
2018-06-19T17:15:07.227Z Waiting for main pipeline to 'finish'
2018-06-19T17:15:07.227Z DONE Query10
==========================================================================================
Run started 2018-06-19T17:14:27.933Z and ran for PT39.294S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.1 24277.7 100000
0001 2.7 37439.2 92000
0002 1.0 102459.0 351
0003 2.1 48638.1 457
0004 1.1 8710.8 40
0005 3.7 27262.8 12
0006 0.7 14598.5 401
0007 9.3 10759.6 1
0008 1.2 86956.5 6000
0009 0.6 15408.3 298
0010 9.9 10130.7 1
0011 *** not run ***
0012 *** not run ***
==========================================================================================
2018-06-19T17:15:07.228Z Running query:11; exportSummaryToBigQuery:true
2018-06-19T17:15:07.230Z Generating 100000 events in batch mode
2018-06-19T17:15:09.615Z Waiting for main pipeline to 'finish'
2018-06-19T17:15:09.615Z DONE Query11
==========================================================================================
Run started 2018-06-19T17:14:27.933Z and ran for PT41.682S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.1 24277.7 100000
0001 2.7 37439.2 92000
0002 1.0 102459.0 351
0003 2.1 48638.1 457
0004 1.1 8710.8 40
0005 3.7 27262.8 12
0006 0.7 14598.5 401
0007 9.3 10759.6 1
0008 1.2 86956.5 6000
0009 0.6 15408.3 298
0010 9.9 10130.7 1
0011 2.2 44984.3 1919
0012 *** not run ***
==========================================================================================
2018-06-19T17:15:09.617Z Running query:12; exportSummaryToBigQuery:true
2018-06-19T17:15:09.618Z Generating 100000 events in batch mode
2018-06-19T17:15:11.029Z Waiting for main pipeline to 'finish'
2018-06-19T17:15:11.029Z DONE Query12
==========================================================================================
Run started 2018-06-19T17:14:27.933Z and ran for PT43.097S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.1 24277.7 100000
0001 2.7 37439.2 92000
0002 1.0 102459.0 351
0003 2.1 48638.1 457
0004 1.1 8710.8 40
0005 3.7 27262.8 12
0006 0.7 14598.5 401
0007 9.3 10759.6 1
0008 1.2 86956.5 6000
0009 0.6 15408.3 298
0010 9.9 10130.7 1
0011 2.2 44984.3 1919
0012 1.3 77459.3 1919
==========================================================================================
Exception in thread "main" ==========================================================================================
Run started 2018-06-19T17:14:27.933Z and ran for PT43.392S
Default configuration:
java.lang.IllegalArgumentException: BigQueryIO.Write needs a GCS temp location to store temp files.
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:122)
Configurations:
Conf Description
at org.apache.beam.sdk.io.gcp.bigquery.BatchLoads.validate(BatchLoads.java:194)
0000 query:0; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
0001 query:1; exportSummaryToBigQuery:true
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
0002 query:2; exportSummaryToBigQuery:true
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
0003 query:3; exportSummaryToBigQuery:true
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
0005 query:5; exportSummaryToBigQuery:true
at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
0007 query:7; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
0008 query:8; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:182)
0010 query:10; exportSummaryToBigQuery:true
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:102)
0011 query:11; exportSummaryToBigQuery:true
at org.apache.beam.sdk.nexmark.Main.main(Main.java:395)
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.1 24277.7 100000
0001 2.7 37439.2 92000
0002 1.0 102459.0 351
0003 2.1 48638.1 457
0004 1.1 8710.8 40
0005 3.7 27262.8 12
0006 0.7 14598.5 401
0007 9.3 10759.6 1
0008 1.2 86956.5 6000
0009 0.6 15408.3 298
0010 9.9 10130.7 1
0011 2.2 44984.3 1919
0012 1.3 77459.3 1919
==========================================================================================
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 45.02 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 4s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/z2mtgbud4ncpi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Direct #16
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/16/display/redirect>
Jenkins build is back to normal :
beam_PostCommit_Java_Nexmark_Direct #15
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/15/display/redirect?page=changes>
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #14
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/14/display/redirect>
------------------------------------------
[...truncated 242.36 KB...]
0001 query:1; exportSummaryToBigQuery:true
SEVERE: Exception not convertible into handled response
0002 query:2; exportSummaryToBigQuery:true
com.google.api.client.googleapis.js 0003 query:3; exportSummaryToBigQuery:true
on.GoogleJsonResponseException: 404 Not Found
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
{
0005 query:5; exportSummaryToBigQuery:true
"code" : 404,
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
"errors" : [ {
0007 query:7; exportSummaryToBigQuery:true
"domain" : "global",
0008 query:8; exportSummaryToBigQuery:true
"message" : "Not Found",
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
"reason" : "notFound"
0010 query:10; exportSummaryToBigQuery:true
} ],
0011 query:11; exportSummaryToBigQuery:true
"message" : "Not Found"
0012 query:12; exportSummaryToBigQuery:true
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
Performance:
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:432)
0000 3.9 25542.8 100000
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
0001 2.9 34211.4 92000
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
0002 0.9 106723.6 351
at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation.call(AbstractGoogleAsyncWriteChannel.java:357)
0003 2.2 45269.4 463
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
0004 1.3 7843.1 40
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
0005 3.4 29815.1 12
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
0006 0.7 14513.8 401
at java.lang.Thread.run(Thread.java:748)
0007 8.8 11388.2 1
0008 1.1 93196.6 6000
Exception in thread "main" org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.io.IOException: Failed to close some writers
0009 0.6 16806.7 298
at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:349)
0010 9.2 10884.9 1
at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:319)
0011 2.1 47192.1 1919
at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:210)
0012 1.4 70028.0 1919
at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:66)
======================================================================== at org.apache.beam.sdk.Pipeline.run(Pipeline.java:311)
==================
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:182)
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:102)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:395)
Caused by: java.io.IOException: Failed to close some writers
at org.apache.beam.sdk.io.gcp.bigquery.WriteBundlesToFiles.finishBundle(WriteBundlesToFiles.java:245)
Suppressed: java.io.IOException: com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
{
"code" : 404,
"errors" : [ {
"domain" : "global",
"message" : "Not Found",
"reason" : "notFound"
} ],
"message" : "Not Found"
}
at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel.waitForCompletionAndThrowIfUploadFailed(AbstractGoogleAsyncWriteChannel.java:431)
at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel.close(AbstractGoogleAsyncWriteChannel.java:289)
at org.apache.beam.sdk.io.gcp.bigquery.TableRowWriter.close(TableRowWriter.java:81)
at org.apache.beam.sdk.io.gcp.bigquery.WriteBundlesToFiles.finishBundle(WriteBundlesToFiles.java:239)
at org.apache.beam.sdk.io.gcp.bigquery.WriteBundlesToFiles$DoFnInvoker.invokeFinishBundle(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.finishBundle(SimpleDoFnRunner.java:195)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.finishBundle(SimplePushbackSideInputDoFnRunner.java:119)
at org.apache.beam.runners.direct.ParDoEvaluator.finishBundle(ParDoEvaluator.java:207)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.finishBundle(DoFnLifecycleManagerRemovingTransformEvaluator.java:74)
at org.apache.beam.runners.direct.DirectTransformExecutor.finishBundle(DirectTransformExecutor.java:189)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:127)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
{
"code" : 404,
"errors" : [ {
"domain" : "global",
"message" : "Not Found",
"reason" : "notFound"
} ],
"message" : "Not Found"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:432)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation.call(AbstractGoogleAsyncWriteChannel.java:357)
... 4 more
Jun 26, 2018 7:43:18 AM com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation call
SEVERE: Exception not convertible into handled response
com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
{
"code" : 404,
"errors" : [ {
"domain" : "global",
"message" : "Not Found",
"reason" : "notFound"
} ],
"message" : "Not Found"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:432)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation.call(AbstractGoogleAsyncWriteChannel.java:357)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 26, 2018 7:43:18 AM com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation call
SEVERE: Exception not convertible into handled response
com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
{
"code" : 404,
"errors" : [ {
"domain" : "global",
"message" : "Not Found",
"reason" : "notFound"
} ],
"message" : "Not Found"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:432)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation.call(AbstractGoogleAsyncWriteChannel.java:357)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 26, 2018 7:43:18 AM com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation call
SEVERE: Exception not convertible into handled response
com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
{
"code" : 404,
"errors" : [ {
"domain" : "global",
"message" : "Not Found",
"reason" : "notFound"
} ],
"message" : "Not Found"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:432)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation.call(AbstractGoogleAsyncWriteChannel.java:357)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 44.527 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 11s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/zon5yk5b7vkfm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user migryz@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user marek.simunek@firma.seznam.cz
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user sourabhbajaj@google.com
Not sending mail to unregistered user mergebot@apache.org
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user thomas.haines@practiceinsight.io
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ddonnelly@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user devon.meunier@shopify.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user basti.lj@alibaba-inc.com
Not sending mail to unregistered user mrtn@nrd.io
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user azur@paypal.com
Not sending mail to unregistered user jamalone@gmail.com
Not sending mail to unregistered user terrencehan@tencent.com
Not sending mail to unregistered user hadarh@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user fjp@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user pgerver@us.ibm.com
Not sending mail to unregistered user jasonkuster@google.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user taro.murao@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wnsdud1861@gmail.com
Not sending mail to unregistered user peihe0@gmail.com
Not sending mail to unregistered user sisk@google.com
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #13
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/13/display/redirect>
------------------------------------------
[...truncated 783.20 KB...]
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 6:25:40 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 6:25:40 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e_34af3974bfffc46e74b6fac77a6300bf_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e/0bb5e313-a4ca-426c-b823-1b039e31e649",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e/0bb5e313-a4ca-426c-b823-1b039e31e649">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 6:25:43 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 6:25:43 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e_88f21591cb178f17b0346776cf4b5772_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e/14fe773f-c573-4342-a8d0-d8d7f64e464d",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e/14fe773f-c573-4342-a8d0-d8d7f64e464d">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 6:25:45 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 6:25:45 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e_21eddab86da3c300218fa613a4167da5_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e/dc113c02-6e9b-49f8-b863-b26531c48511",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e/dc113c02-6e9b-49f8-b863-b26531c48511">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 6:25:45 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 6:25:45 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e_9b9803e4d85d250dd96ec9b804847858_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e/7d423eef-5ff4-408b-882f-8f156fc84752",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211824198d7d04d_eb29716c524e4dfeb9b06c0cf84ed26e/7d423eef-5ff4-408b-882f-8f156fc84752">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 5,5,main]) completed. Took 2 mins 15.156 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 4s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/qcgan4466kq5m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user migryz@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user marek.simunek@firma.seznam.cz
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user sourabhbajaj@google.com
Not sending mail to unregistered user mergebot@apache.org
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user thomas.haines@practiceinsight.io
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ddonnelly@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user devon.meunier@shopify.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user basti.lj@alibaba-inc.com
Not sending mail to unregistered user mrtn@nrd.io
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user azur@paypal.com
Not sending mail to unregistered user jamalone@gmail.com
Not sending mail to unregistered user terrencehan@tencent.com
Not sending mail to unregistered user hadarh@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user fjp@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user pgerver@us.ibm.com
Not sending mail to unregistered user jasonkuster@google.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user taro.murao@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wnsdud1861@gmail.com
Not sending mail to unregistered user peihe0@gmail.com
Not sending mail to unregistered user sisk@google.com
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #12
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/12/display/redirect?page=changes>
Changes:
[ankurgoenka] Fixing key lookup in FlinkBatchSideInputHandlerFactory.SideInputHandler
------------------------------------------
[...truncated 782.50 KB...]
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 6:01:39 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 6:01:39 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb_25c3f1e0f258f55a87c41f995af556c4_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb/449c1f56-2412-40f2-aad2-0576293796fc",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb/449c1f56-2412-40f2-aad2-0576293796fc">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 6:01:40 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 6:01:40 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb_0d1fdcb42fe07df4e85d95c270acacef_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb/cb11bd3b-ac51-4611-ab35-1821bf5378c1",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb/cb11bd3b-ac51-4611-ab35-1821bf5378c1">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 6:01:44 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 6:01:44 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb_4166c20ccf1ef8666f09ba6638377926_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb/c19d7210-1539-41b8-859d-7a57891375e9",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb/c19d7210-1539-41b8-859d-7a57891375e9">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 6:01:44 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 6:01:44 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb_54e955a04778bc7653ffa45b12c1efbb_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb/11470cc5-a0ab-432e-9e5f-f9c5f77045b9",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211800136b836ce2_4ec3ac7454ca4ffdb467ad8716bf04eb/11470cc5-a0ab-432e-9e5f-f9c5f77045b9">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 5,5,main]) completed. Took 2 mins 20.947 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 59s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/zvmukop5q65tu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user migryz@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user marek.simunek@firma.seznam.cz
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user sourabhbajaj@google.com
Not sending mail to unregistered user mergebot@apache.org
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user thomas.haines@practiceinsight.io
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ddonnelly@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user devon.meunier@shopify.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user basti.lj@alibaba-inc.com
Not sending mail to unregistered user mrtn@nrd.io
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user azur@paypal.com
Not sending mail to unregistered user jamalone@gmail.com
Not sending mail to unregistered user terrencehan@tencent.com
Not sending mail to unregistered user hadarh@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user fjp@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user pgerver@us.ibm.com
Not sending mail to unregistered user jasonkuster@google.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user taro.murao@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wnsdud1861@gmail.com
Not sending mail to unregistered user peihe0@gmail.com
Not sending mail to unregistered user sisk@google.com
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #11
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/11/display/redirect>
------------------------------------------
[...truncated 782.49 KB...]
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 5:42:36 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 5:42:36 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea_88f21591cb178f17b0346776cf4b5772_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea/8ef2bc04-2628-4b63-9560-c35598e476f4",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea/8ef2bc04-2628-4b63-9560-c35598e476f4">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 5:42:40 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 5:42:40 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea_90e2215a95b50f988fe016e90337a8cc_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea/5320b9b1-0cd6-4858-89bf-9240b8b2874c",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea/5320b9b1-0cd6-4858-89bf-9240b8b2874c">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 5:42:41 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 5:42:41 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea_54e955a04778bc7653ffa45b12c1efbb_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea/9b6cbaf9-bd23-4b03-aeca-b1187f834c24",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea/9b6cbaf9-bd23-4b03-aeca-b1187f834c24">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 5:42:42 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 5:42:42 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea_4225400f7c8c5f1f426934c478aa8e65_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea/1ce921f9-f737-402d-a965-041b8094b4f5",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621174118d21af06a_aa9dd8101e2d41709e44e5f74e6d46ea/1ce921f9-f737-402d-a965-041b8094b4f5">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 2 mins 13.738 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 53s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/7ywawgs57ssru
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user migryz@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user marek.simunek@firma.seznam.cz
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user sourabhbajaj@google.com
Not sending mail to unregistered user mergebot@apache.org
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user thomas.haines@practiceinsight.io
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ddonnelly@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user devon.meunier@shopify.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user basti.lj@alibaba-inc.com
Not sending mail to unregistered user mrtn@nrd.io
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user azur@paypal.com
Not sending mail to unregistered user jamalone@gmail.com
Not sending mail to unregistered user terrencehan@tencent.com
Not sending mail to unregistered user hadarh@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user fjp@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user pgerver@us.ibm.com
Not sending mail to unregistered user jasonkuster@google.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user taro.murao@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wnsdud1861@gmail.com
Not sending mail to unregistered user peihe0@gmail.com
Not sending mail to unregistered user sisk@google.com
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #10
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/10/display/redirect?page=changes>
Changes:
[robertwb] [BEAM-4565] Fix hot key fanout in the face of combiner lifting.
[robertwb] Fix and test global combine with fanout.
[migryz] Point gearpump to master
------------------------------------------
[...truncated 789.87 KB...]
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 5:37:22 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 5:37:22 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401_dd545fcc26e636a05b36351e45d002e7_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401/a359ea65-3185-4af1-907b-1de0496bc3b6",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401/a359ea65-3185-4af1-907b-1de0496bc3b6">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 5:37:25 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 5:37:25 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401_21eddab86da3c300218fa613a4167da5_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401/a08a28bd-4b33-4840-87d1-bfd661b6ee49",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401/a08a28bd-4b33-4840-87d1-bfd661b6ee49">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 5:37:25 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 5:37:25 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401_25c3f1e0f258f55a87c41f995af556c4_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401/f7a454fc-5bd1-4b9b-84d8-4f4a1b0c0466",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401/f7a454fc-5bd1-4b9b-84d8-4f4a1b0c0466">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 5:37:29 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 5:37:29 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401_9f64b7ad596bc12e6fb3bb96b724b5a6_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401/363bfc15-9d20-444d-84e1-956ff13af479",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins06211735545acbf386_52864a76a1e146158193170d79e7e401/363bfc15-9d20-444d-84e1-956ff13af479">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 3 mins 20.16 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 52s
59 actionable tasks: 56 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/45yr7sqbbrgvg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user migryz@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user marek.simunek@firma.seznam.cz
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user sourabhbajaj@google.com
Not sending mail to unregistered user mergebot@apache.org
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user thomas.haines@practiceinsight.io
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ddonnelly@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user devon.meunier@shopify.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user basti.lj@alibaba-inc.com
Not sending mail to unregistered user mrtn@nrd.io
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user azur@paypal.com
Not sending mail to unregistered user jamalone@gmail.com
Not sending mail to unregistered user terrencehan@tencent.com
Not sending mail to unregistered user hadarh@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user fjp@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user pgerver@us.ibm.com
Not sending mail to unregistered user jasonkuster@google.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user taro.murao@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wnsdud1861@gmail.com
Not sending mail to unregistered user peihe0@gmail.com
Not sending mail to unregistered user sisk@google.com
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #9
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/9/display/redirect?page=changes>
Changes:
[matthias] Futurize examples subpackage
[kirpichov] A couple more trivial changes extracted from #5662
[katarzyna.kucharczyk] Created static retry method which accepts retriable method, amount of
[rober] Fix build break from PR 5676, which modified method signatures.
[migryz] Implemented working prototype for PostCommit jobs
[migryz] Update post commit jobs to utilize new helper methods
[ankurgoenka] Fix cache references in portable flink runner
[Pablo] Adding ignore parameters for gitattributes
[swegner] Remove submodule
[migryz] Fix typo in _ghprb suffix
[migryz] Update suffix to be PullRequest
[ccy] Revert #5689 to fix build
[ankurgoenka] Remove unused import
[github] Make suffix shorter
[kirpichov] Make ImmutableExecutableStage constructors public
[kirpichov] [BEAM-4285] Implement Flink batch side input handler
[ekirpichov] Introduces PipelineValidator that checks the well-formedness of a
[cademarkegard] [BEAM-4325] Enforce ErrorProne analysis in the SQL project
[echauchot] [BEAM-4283] Fix naming of the BigQuery fields
[coheigea] Removing some null checks, where we already know that the variable in
[iemejia] [BEAM-3314] Set correctly host and port on RedisIO
[iemejia] [BEAM-3314] Fix error-prone warnings and add extra test for Read
------------------------------------------
[...truncated 781.75 KB...]
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 2:43:04 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 2:43:04 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a_54e955a04778bc7653ffa45b12c1efbb_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a/e76d830f-f13e-4020-af12-d09a59308927",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a/e76d830f-f13e-4020-af12-d09a59308927">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 2:43:06 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 2:43:06 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a_34af3974bfffc46e74b6fac77a6300bf_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a/361b624b-e7db-4a9f-90ac-19f23e887db1",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a/361b624b-e7db-4a9f-90ac-19f23e887db1">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 2:43:08 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 2:43:08 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a_4225400f7c8c5f1f426934c478aa8e65_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a/30b27a75-f27d-4e5c-973f-61d7e4982448",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a/30b27a75-f27d-4e5c-973f-61d7e4982448">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 2:43:10 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 2:43:10 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a_d9119dcc1ac52a24d6ba3473d6a64483_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a/df3cf0a2-748a-4d9f-99b0-859479bd45e9",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621144142c87d731c_04f4d9e503204f638ce033c514a40e5a/df3cf0a2-748a-4d9f-99b0-859479bd45e9">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 2 mins 12.573 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 35s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/pkzdhbsru26dy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user migryz@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user marek.simunek@firma.seznam.cz
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user sourabhbajaj@google.com
Not sending mail to unregistered user mergebot@apache.org
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user thomas.haines@practiceinsight.io
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ddonnelly@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user devon.meunier@shopify.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user basti.lj@alibaba-inc.com
Not sending mail to unregistered user mrtn@nrd.io
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user azur@paypal.com
Not sending mail to unregistered user jamalone@gmail.com
Not sending mail to unregistered user terrencehan@tencent.com
Not sending mail to unregistered user hadarh@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user fjp@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user pgerver@us.ibm.com
Not sending mail to unregistered user jasonkuster@google.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user taro.murao@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wnsdud1861@gmail.com
Not sending mail to unregistered user peihe0@gmail.com
Not sending mail to unregistered user sisk@google.com
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #8
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/8/display/redirect>
------------------------------------------
[...truncated 782.53 KB...]
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 2:23:14 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 2:23:14 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20_21eddab86da3c300218fa613a4167da5_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20/bde1bda4-ba0f-41d5-81b4-7b57b7b5fcfe",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20/bde1bda4-ba0f-41d5-81b4-7b57b7b5fcfe">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 2:23:18 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 2:23:18 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20_d9119dcc1ac52a24d6ba3473d6a64483_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20/e4dfe4db-415f-4e6e-95f9-f19cda735499",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20/e4dfe4db-415f-4e6e-95f9-f19cda735499">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 2:23:21 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 2:23:21 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20_0d1fdcb42fe07df4e85d95c270acacef_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20/8cdc59e9-b965-4518-8a58-b3ef015afc97",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20/8cdc59e9-b965-4518-8a58-b3ef015afc97">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 21, 2018 2:23:24 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 21, 2018 2:23:24 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20_4225400f7c8c5f1f426934c478aa8e65_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20/60e6b54a-fe68-4a3d-b57b-e25748a466e8",>
"reason" : "invalid"
} ],
"message" : "Source URI must be a Google Cloud Storage location: <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/ws/src/sdks/java/nexmark/nexmark-temp/BigQueryWriteTemp/beam_load_mainjenkins0621142156f123ea50_835921e2a3b24a758c84551462757a20/60e6b54a-fe68-4a3d-b57b-e25748a466e8">
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 2 mins 14.406 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 38s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/6p5nhignudlhs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user marek.simunek@firma.seznam.cz
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user sourabhbajaj@google.com
Not sending mail to unregistered user mergebot@apache.org
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user thomas.haines@practiceinsight.io
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ddonnelly@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user devon.meunier@shopify.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user basti.lj@alibaba-inc.com
Not sending mail to unregistered user mrtn@nrd.io
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user azur@paypal.com
Not sending mail to unregistered user jamalone@gmail.com
Not sending mail to unregistered user terrencehan@tencent.com
Not sending mail to unregistered user hadarh@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user fjp@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user pgerver@us.ibm.com
Not sending mail to unregistered user jasonkuster@google.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user taro.murao@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wnsdud1861@gmail.com
Not sending mail to unregistered user peihe0@gmail.com
Not sending mail to unregistered user sisk@google.com
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #7
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/7/display/redirect>
------------------------------------------
[...truncated 761.32 KB...]
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 6:28:28 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 6:28:28 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06201827053316be32_ce0b7576085a40eca52060f7b358f582_54e955a04778bc7653ffa45b12c1efbb_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 6:28:35 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 6:28:35 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06201827053316be32_ce0b7576085a40eca52060f7b358f582_4166c20ccf1ef8666f09ba6638377926_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 6:28:36 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 6:28:36 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06201827053316be32_ce0b7576085a40eca52060f7b358f582_25c3f1e0f258f55a87c41f995af556c4_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 6:28:39 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 6:28:39 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06201827053316be32_ce0b7576085a40eca52060f7b358f582_9b9803e4d85d250dd96ec9b804847858_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 2 mins 19.703 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 41s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/2ywxqzo63wueu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user marek.simunek@firma.seznam.cz
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user sourabhbajaj@google.com
Not sending mail to unregistered user mergebot@apache.org
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user thomas.haines@practiceinsight.io
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ddonnelly@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user devon.meunier@shopify.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user basti.lj@alibaba-inc.com
Not sending mail to unregistered user mrtn@nrd.io
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user azur@paypal.com
Not sending mail to unregistered user jamalone@gmail.com
Not sending mail to unregistered user terrencehan@tencent.com
Not sending mail to unregistered user hadarh@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user fjp@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user pgerver@us.ibm.com
Not sending mail to unregistered user jasonkuster@google.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user taro.murao@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wnsdud1861@gmail.com
Not sending mail to unregistered user peihe0@gmail.com
Not sending mail to unregistered user sisk@google.com
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #6
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/6/display/redirect?page=changes>
Changes:
[ehudm] Jupyter notebook for monitoring precommit job times
------------------------------------------
[...truncated 761.36 KB...]
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 5:43:06 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 5:43:06 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06201741478a5ddf36_8c8bd70a3d8a4ca1914d3feb874a9312_d9119dcc1ac52a24d6ba3473d6a64483_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 5:43:12 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 5:43:12 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06201741478a5ddf36_8c8bd70a3d8a4ca1914d3feb874a9312_54e955a04778bc7653ffa45b12c1efbb_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 5:43:14 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 5:43:14 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06201741478a5ddf36_8c8bd70a3d8a4ca1914d3feb874a9312_4166c20ccf1ef8666f09ba6638377926_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 5:43:24 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 5:43:24 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins06201741478a5ddf36_8c8bd70a3d8a4ca1914d3feb874a9312_dd545fcc26e636a05b36351e45d002e7_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 2 mins 23.874 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 55s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/th4x4xirudwmy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user marek.simunek@firma.seznam.cz
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user sourabhbajaj@google.com
Not sending mail to unregistered user mergebot@apache.org
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user thomas.haines@practiceinsight.io
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ddonnelly@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user devon.meunier@shopify.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user basti.lj@alibaba-inc.com
Not sending mail to unregistered user mrtn@nrd.io
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user azur@paypal.com
Not sending mail to unregistered user jamalone@gmail.com
Not sending mail to unregistered user terrencehan@tencent.com
Not sending mail to unregistered user hadarh@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user fjp@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user pgerver@us.ibm.com
Not sending mail to unregistered user jasonkuster@google.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user taro.murao@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wnsdud1861@gmail.com
Not sending mail to unregistered user peihe0@gmail.com
Not sending mail to unregistered user sisk@google.com
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #5
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/5/display/redirect?page=changes>
Changes:
[jamalone] Initial add
[stefano] Fix duplicated Stephan Ewen
[stefano] Fix broken mailto
[jamalone] Fix for timezone
[jamalone] Addition of Twitter and Blog details to index.
[klk] Add apache ID 'kenn' for Kenneth Knowles
[jamalone] New blog post; changes to logos.
[jamalone] Fix for blog post.
[jamalone] Edit to index page
[Max] change output directory to "content"
[jbonofre] Fix jbonofre e-mail
[mxm] Team Updates
[takidau] Capability matrix page + blog post: - Content as discussed in this
[davor] Add content files missed in PR2 due to an overly aggressive .gitignore
[takidau] Blog page "read more" links + README.md for the site.
[takidau] Remove trailing slash in blog "read more" links
[mrtn] Fix 'getting started page' link in homepage alert message
[davor] Add apache_ids for everyone that has one at this time.
[davor] Add contribution guide
[takidau] Capability matrix updates: - Add sliding window support for batch Spark
[davor] Addition of public materials page/post
[jamalone] Addition of public meetings page
[jamalone] Update for second meeting
[jamalone] Update for email list
[jamalone] Update to meeting page
[jamalone] Addition of material page; nav fixes
[ddonnelly] Added the /docs/ directory and a landing page at docs/index.md. Added
[iemejia] Add button to make the navigation bar accesible in mobile browsing
[jamalone] Addition of PCollection blog post; blog fix
[jamalone] Addition of sAF blog; delay of PCollection post.
[mxm] [BEAM-103] update capability matrix
[jamalone] Update date for blog post
[robertwb] Remove duplicate paragraph.
[robertwb] Fix blog post typo.
[davor] Add Flink Batch Runner Blog Post
[davor] Add a blog post about the first release
[davor] Add a page about releases
[davor] Add Javadoc for version 0.1.0-incubating
[jamalone] Fixed HTML errors; added link and HTML tests via rake
[github] added incubation disclaimer
[github] fixed typo
[fjp] Merged in pullhttps://github.com/apache/beam-site/pull/25 and
[fjp] Adding Travis CI YAML config
[dhalperi] [BEAM-500] Finished skeleton of new website layout
[dhalperi] [BEAM-510] releases: use ASF download script to balance load on Apache
[fjp] Fixed remaining rake failure.
[klk] Moved javadoc under /learn/sdks/java and added the links back
[fjp] Addressed BEAM-514 (add required asf links)
[fjp] Addressed Beam-515 (apache logos)
[dhalperi] Minor fixups
[dhalperi] Navbar: move ASF dropdown to right side
[dhalperi] Minor style tweaks for alignment
[dhalperi] Fix ASF header collapsing
[dhalperi] Added a half birthday blog post, as discussed on dev@.
[dhalperi] Update to today
[dhalperi] Add a link to the Apache Code of Conduct
[klk] Revise Beam programming guide for new DoFn
[jasonkuster] Add testing guide to website.
[mxm] [BEAM-102] update capability matrix
[jason] Updated per PR comments
[fjp] Added toc
[dhalperi] Update downloads link to 0.2.0-incubating
[dhalperi] Upgrade Javadoc to 0.2.0-incubating
[dhalperi] Build fix for Travis
[terrencehan] minor: remove duplicate words
[fjp] Added blog post about Strata+Hadoop World tutorial. Added Jesse Anderson
[fjp] Regenerate html and make 'rake test' pass.
[fjp] Added bundler gem to README.
[fjp] Update mailing lists to use new lists site.
[fjp] Add Design Principles (take from the original Beam technical vision
[fjp] Remove page title from TOCs
[fjp] Updated Contribution Guide & added Work In Progress * Added section on
[fjp] Add Blog Post on TestStream
[dhalperi] Add release guide to the website
[fjp] Updated website instructions to use Bundler correctly for managing ruby
[fjp] Turn on existing syntax highlighting styles.
[fjp] Enable syntax highlighting in @tgroh's blog.
[davor] Update to Beam committers
[fjp] Removed TriggerTester, obsoleted in
[fjp] Add IDE setup instructions
[fjp] Reordered IDE section after code checkout and tweaked heading levels.
[davor] [BEAM-501] New skin proposal
[fjp] Add a first version of the WordCount walkthrough.
[fjp] Temporarily disable tests for v2/, since the links are all fake
[fjp] Add downstream merge exemption to contribution guide
[swegner] Add IntelliJ Checkstyle documentation
[aljoscha.krettek] Add pointers to 0.3.0-incubating release artifacts
[davor] Flink compatibility matrix: drop redundant text
[davor] [BEAM-752] Infrastructure for toggling code snippets in documentation
[davor] Add Mobile gaming walkthrough
[davor] New structure
[davor] Move Javadoc from learn/sdks to documentation/sdks.
[davor] [BEAM-890] Update compatibility matrix for Spark.
[dhalperi] Add missing site.baseurls
[dhalperi] Build in a separate content directory to catch bad links
[davor] Move files
[davor] Update README.md and _config.yml after moving the source to the src/
[fjp] Initial pass on a real Quickstart
[davor] Remove unnecessary build timestamps in the generated site
[davor] Fix typo in file name (materix -> matrix)
[davor] BEAM-845 Update navigation and runner capability matrix to include Apex.
[davor] [BEAM-902] Added runner toggles [BEAM-752] Infrastructure for toggling
[davor] Introduce site.release_latest global variable to facilitate Javadoc
[dhalperi] Add note about gpg-agent to release-guide
[dhalperi] Ignore more generated/internal Javadoc in Release Guide
[dhalperi] Tweak gpg-agent text, move to GPG setup instructions
[davor] Add tool to fix links.
[jason] Remove parser since it's not on the executors.
[davor] Update beam_team Committer IDs
[thw] Update Apex runner info after merge to master.
[github] "before" instead of "behind" for "early" elements
[davor] [BEAM-505] Fill in the documentation/runners/direct portion of the
[davor] [BEAM-508] Fill in the documentation/runners/dataflow portion of the
[davor] Use jekyll site.release_latest variable in direct runner sample pom.xml
[davor] Add Jenkins job definitions for existing projects using Jenkins DSL
[davor] Update content on v2 landing page
[fjp] Add Python SDK page and add it to /documentation/index.md
[fjp] Rename /get-started/releases to get-started/downloads. Delete old
[aljoscha.krettek] [BEAM-899] Add Flink Instructions to quickstart.md
[davor] Remove Apex runner from work in progress
[aljoscha.krettek] [BEAM-1007] Fixed toggles code, to work in safari
[davor] Update download page to specify backward-compatibility guarantees
[davor] Quickstart: suggest using nightly build temporarily
[davor] Add maturity model assessment
[davor] Add commiter/PMC bar information
[davor] Add contribution diversity
[davor] Update documentation/pipelines/design-your-pipeline.md. Add 5 images for
[davor] Add external link icon to Java SDK API reference, and change to open in
[davor] Update main landing page and Beam Overview page
[davor] [BEAM-277] Add transforms section to the programming guide
[dhalperi] [BEAM-506] Fill in the documentation/runners/flink portion of the
[dhalperi] Website: minor typographical corrections
[davor] Simplify Flink Runner instructions for running on cluster
[davor] fixed command to run WordCount example on direct runner, now in the site
[davor] Update Additional Resources page
[davor] [BEAM-507] Fill in the documentation/runners/spark portion of the
[klk] Rename PTransform apply to expand throughout
[tgroh] [BEAM-835] Added IntelliJ instructions to the contribution guide
[tgroh] Reword IntelliJ Annotation Processor section
[davor] [BEAM-900] Spark quickstart instructions.
[davor] Dataflow quickstart fix
[davor] Add DOAP file for the project
[davor] Remove incubating references
[davor] [BEAM-1220] Update team.md with post-graduation committer list
[davor] [BEAM-1163] Add signature keys to the vote template (release guide)
[davor] Add clarification to original pull request
[davor] Update website pull request instructions in the Release Guide
[davor] Additional clarifications to pull request
[davor] Update Release Guide: exclude apex runner translation package from the
[davor] Updated Wordcount, Mobile gaming, and Using the Docs pages.
[dhalperi] Added python supports in Programming Guide
[davor] Update Release Guide as part of the post graduation tasks
[dhalperi] Rename apache_beam.utils.options to apache_beam.utils.pipeline_options
[davor] Add .htaccess to automatically forward HTTP to HTTP
[jbonofre] Add 0.4.0 release
[dhalperi] test-your-pipeline: use site.baseurl, site.release_latest, canonical
[davor] Added post for 0.4.0 release with Apex runner addition.
[davor] Publish a blog about Apache Apex runner
[davor] Publish a blog about Apache Apex, second attempt
[davor] testing.md: fix links to project
[davor] Pass over the contribution guide
[github] Limit the number of blog posts listed on the main page
[github] Update copyright on each page
[davor] Update maturity model to reflect graduation
[davor] Blog post on Beam graduation
[robertwb] Add plugin for snippet extraction.
[robertwb] Replace literal code samples with extracted, tested snippets.
[dhalperi] [BEAM-278] Add I/O section to programming guide
[dhalperi] Update according to reviewer comments
[dhalperi] minor fixes
[davor] Clarify maturity of various runners.
[jbonofre] Use PMC instead of PPMC
[davor] Adds PTransform style guide
[davor] WIP: Add Python to WordCount documentation
[davor] Added Python Quickstart
[davor] Update documentation to remove python-sdk branch references
[altay] Add new committers to the team.
[davor] Cleanup of links: relative instead of absolute, https instead of http,
[davor] Blog: "Media recap of the Apache Beam graduation"
[davor] Disable Travis coverage
[davor] Standardize Jenkins suites into .jenkins directory
[github] Fix typo in programming-guide.md
[davor] Delete jobs due to move to main repo.
[altay] Add page about python type safety and type hints
[davor] Add 0.5.0 release
[klk] Update the capability matrix for state and timers
[fjp] Update programming guide with Python snippets and data encoding section.
[davor] Add documentation to build the site with a jekyll container
[melissapa] Add back composite transforms anchor to fix broken links
[dhalperi] processBatch() is now called processBundle()
[altay] Add new Managing Python Pipeline Dependencies page
[altay] Update ParDo documentation for Python
[davor] Add klk as a blog author
[davor] Add blog post "Stateful Processing with Apache Beam"
[klk] Fix typo in stateful processing post
[iemejia] Fix some typos and small formatting issues.
[klk] Touch up some punctuation in state blog post
[davor] Clarify state further in capability matrix
[altay] Add custom sources and sinks for Python page
[dhalperi] [BEAM-475] update release instructions for javadoc
[dhalperi] Minor tweaks
[melissapa] Fix broken links due to code path changes
[davor] Add Apache in front of initial Beam reference
[sourabhbajaj] [BEAM-1320] Update release guide to create pydocs
[sourabhbajaj] Fix broken links
[staslevin] Adding testing related info: TestPipeline, API surface.
[altay] Fix the quickstart documentation
[altay] Update quickstart to have runner specific examples
[thomas.haines] BEAM-1559 add HBase docs
[davor] Add contrib guide comments about using squash & force push.
[davor] Comment Ostatic link as it has been broken for a few weeks
[iemejia] [BEAM-325] Add Slack details to website
[mairbek] Typo fix in "Reading Data Into Your Pipeline" example.
[wnsdud1861] Fixed typos (from distributed to distributed)
[altay] Finding a typo in a code block
[davor] Fix possible erranous naming conventions reference
[azur] Add IntelliJ files to .gitignore
[davor] [BEAM-1652] Code style instructions for IntelliJ in contribution guide.
[davor] Documentation changes for 0.6.0 release.
[sourabhbajaj] Add htaccess back
[altay] Changes to web site related to recently released Python SDK
[devon.meunier] Typo fix
[davor] Blog post for 0.6.0 release with python sdk
[kirpichov] Add jkff as committer
[iemejia] Add iemejia as committer
[davor] Add Pipeline I/O section to website - outline + move some existing
[davor] Add chamikara as a committer
[azur] Add aviemzur as committer
[iemejia] Improve committing website changes section in the contribution guide
[iemejia] Fix timezone to America/Los_Angeles
[peihe0] Change peihe company affiliation to Alibaba.
[davor] Simplify merge process section
[davor] Add windowing section to programming guide
[altay] Simplify python quick start.
[davor] add code snippet to page design-your-pipeline
[klk] Reword RunnableOnService to ValidatesRunner
[aljoscha.krettek] Update Capability Matrix: Flink supports state/timers in batch mode
[sourabhbajaj] Fix the link to the apache ICLA
[sourabhbajaj] [BEAM-1711] Add information about extra requires in Python Quickstart
[altay] Docker server command should run non-incremental build
[altay] Add "In-Progress" info to the Built-in I/O Transforms page
[altay] Add Read Transform content for Authoring I/O Transforms - Overview
[sisk] Add to in-progress IO list and alphabetize
[azur] Add JSON as a planned IO to built-in IOs page.
[github] Update quickstart-java.md
[dhalperi] [BEAM-1949] Associated doc changes for renaming sideOutput to output
[dhalperi] add CoGroupByKey to chapter 'Using GroupByKey'
[aljoscha.krettek] remove extra streaming refs in capability matrix: Flink state/timers
[davor] Track RestIO in In-Progress I/O Transforms
[dhalperi] [BEAM-1272] Align the naming of "generateInitialSplits" and
[davor] [BEAM-1949] Doc changes for Python SideOutputValue to OutputValue rename
[davor] [BEAM-1741] Update direct and Cloud Dataflow runner pages with Python
[davor] Update overview page.
[davor] update release notes post 0.6.0 release
[aljoscha.krettek] Update flink page ref from language-python to language-py and add toggle
[davor] [BEAM-919] Remove remaining old use/learn links from website src
[davor] [BEAM-825] Fill in the documentation/runners/apex portion of the website
[davor] Fix Apex runner instructions (pending review comments and other changes)
[davor] [BEAM-1452] Add composite transforms section to programming guide
[davor] [BEAM-1011] Add triggers content to the programming guide
[altay] [BEAM-1695] Improve Python-SDK's programming guide
[lcwik] Fix broken HDFS link on built-in IO page
[altay] [BEAM-2142] Add composite transforms Python snippets to programming
[altay] Add Python snippets to Mobile Gaming.
[klk] [BEAM-969] Add a gearpump runner web page
[klk] Minor touch-ups to Gearpump listing on overview
[davor] add SQL_DSL to page 'work-in-progress'
[davor] Transfer some content from Create Your Pipeline to the Programming
[davor] Add trademark symbol to the Downloads page
[altay] Remove README.md references from the website
[altay] Migrate hadoop inputformat to website
[altay] Move extension README files to website
[melissapa] Add quickstart step re: Python 2.7.x requirement
[altay] fix typos in hadoop io documentation
[davor] Release guide: fix instructions
[davor] Revise WordCount Example Walkthrough
[altay] Quick start should not default to java quickstart
[kirpichov] Rewrites the section on Coders to not talk about them as a parsing
[kirpichov] [BEAM-1353] Style Guide fixups
[dhalperi] [BEAM-501] Large visual refresh of Apache Beam website homepage
[dhalperi] Shorten quotes and fix a typo
[dhalperi] [BEAM-501] fix quotes
[dhalperi] Update latest version metadata information
[dhalperi] Add version 2.0.0 to Downloads page
[dhalperi] Python: fix links to PipelineOptions after move from utils to options
[dhalperi] Update Java Quickstart to stop using snapshot repos
[davor] Add a draft of the Beam FSR blog post
[github] TikaIO JIRA number fix
[github] Added Cloud Spanner Connector
[hadarh] Add 'how to run' directions to WordCount for all runners.
[dhalperi] remove note about JIRA
[dhalperi] Changing Aggregators to Metrics in capability matrix
[dhalperi] fixups
[dhalperi] Do not use BeautifulSoup prettify, which is known to corrupt HTML
[chamikara] Updates contribution guide to include development and testing
[iemejia] Add HadoopInputFormatIO example to read from Hive's HCatalog
[klk] Add support for "no-toggle" code snippets
[klk] Add Beam Runner Guide
[iemejia] Update IO with CassandraIO
[iemejia] Add Hive (HCatalog) to the list of available I/O transforms
[altay] Mention python setup.py sdist and link to its docs
[altay] [BEAM-2437] Input path should be flexible in quickstart
[iemejia] Add Amazon DynamoDB example using HadoopInputFormatIO
[aljoscha.krettek] Update to more recent Flink version in example
[aljoscha.krettek] Add note about Scala version when setting up Flink cluster
[github] Remove references to Travis.
[github] No longer working title
[mergebot] Update build-in IO list with AMQP
[mergebot] Remove AMQPIO from in-progress list
[mergebot] Fix missing closing element
[mergebot] Add JingsongLee as committer
[mergebot] Restore index.html and fix order
[thw] update apex runner properties example
[github] Remove incorrect info from testing page.
[github] Drop the word reviewer from the contribution guide
[mariagh] Fix broken links
[mariagh] Update to latest version
[mariagh] Address review comments
[mariagh] Address review comments
[mergebot] Includes Splittable DoFn in the capability matrix
[mergebot] [BEAM-2500] List Amazon S3 File System as a planned I/O.
[mergebot] Port of Google doc
[mergebot] IO Testing, unit tests: update after readthrough
[mergebot] fixup! IO Testing, unit tests: update after readthrough
[mergebot] fixup! fixup! IO Testing, unit tests: update after readthrough
[mergebot] [BEAM-2638] Add Elasticsearch (v2 and upcoming v5) and MQTT to Built-in
[mergebot] [BEAM-2126] Add JStorm runner to ongoing projects.
[mergebot] Add initial text for I/O Integration Test documentation
[mergebot] fixup! Add initial text for I/O Integration Test documentation
[mergebot] Updated IO IT docs based on PR feedback
[mergebot] Update JDBC IO IT docs based on PR feedback.
[kirpichov] Update a dead link to Jenkins builds.
[kirpichov] Add Apache Solr to the list of Built-In I/O Transforms
[kirpichov] A couple of fixes to website
[kirpichov] Expands the sections on Coders and Validation in Style Guide
[mxm] Update company affiliation
[azur] Update PMC
[altay] Update PMC
[mergebot] Add MapReduce and Tez runners to ongoing projects.
[mergebot] Splittable DoFn blog post.
[mergebot] Add Manu Zhang to committers list
[mergebot] add a page for DSLs:SQL
[mergebot] fix typo issues
[mergebot] add intro of BeamSqlRow, trigger settings of aggregation/join,
[mergebot] typo fix
[mergebot] change page dsls/sql.md into a blog post
[mergebot] split into 1 blog + 1 development doc.
[mergebot] fix broken link
[mergebot] update to latest API/usages
[mergebot] remove post page move internal imple to the end of page
[altay] Publish release 2.1.0
[altay] Fix quote
[mergebot] [BEAM-2780] Fix Window sample code in programming guide
[takidau] [BEAM-2800] Revamp sections 1 and 2 of DSL SQL docs: - Expand BeamRecord
[takidau] Remove TODO
[altay] Add tfrecord io to builtin io list
[mingmxu] add SQL grammar in BNF
[mingmxu] correct the syntax of ORDER_BY LIMIT
[klk] Add blog post with timely processing
[kirpichov] Adds guidance on how to test transform configuration/validation
[altay] [rebase] add MingminXu to team.md
[altay] Add James Xu(xumingming) as committer
[altay] Add Reuven Lax to committers list.
[kirpichov] Fixes SDF blog post after rename of Match to FileIO.match
[altay] Document stale PR policy
[huafengw] Update Gearpump runner related pages
[melissapa] [BEAM-2510] Link to SDK pages from the quickstarts
[mergebot] [BEAM-2869] Add dates to releases on downloads page
[mergebot] [BEAM-1534] Add docker images documentation to the website
[mergebot] [BEAM-2726] Fix typo in programming guide
[mergebot] [BEAM-893] Update mobile gaming example
[mergebot] Update with review feedback
[mergebot] [BEAM-2839, BEAM-2838] Add MapReduce runner to Beam asf-site.
[mergebot] fixup: address comments.
[mergebot] fixup: address comments.
[mergebot] fixup: address comments.
[melissapa] [BEAM-667] Verify and update wordcount snippets
[melissapa] Update with review feedback
[melissapa] Update with review feedback
[melissapa] [BEAM-2039] Number programming guide chapters
[melissapa] Updates with review feedback
[mergebot] Update Mapreduce capability matrix when/how entries
[mergebot] Remove extraneous type variable from StateSpec in state blog post
[melissapa] Add Cloud Resource Manager API to the required API list
[melissapa] Add new execution model page and associated images
[melissapa] Update with review feedback and new diagrams
[melissapa] More updates from review feedback
[basti.lj] [BEAM-2666] Add JStorm runner to Beam asf-site.
[mergebot] Update source-repository.md
[mergebot] [BEAM-2335] Document how to run NeedsRunner tests.
[mergebot] fixup! [BEAM-2335] Document how to run NeedsRunner tests.
[mergebot] Manually add missed files from content dir
[iemejia] [BEAM-2727] Add build information to the vote email template
[altay] [BEAM-2853] Move the nexmark documentation to the website
[altay] fixups
[melissapa] Fix dead link
[mergebot] [MINOR] Updated hero and cards background to use background-size: cover
[jbonofre] Add RedisIO in the built-in set
[jbonofre] Move Elasticsearch v5.x from in-progress to built-in
[altay] [BEAM-664] Update docs: MinimalWordCount in Java is intentionally
[herohde] [BEAM-3121] Remove broken docker script and documentation
[klk] New top menu plus side nav layout
[mergebot] [BEAM-1934] Add more CoGroupByKey content/examples
[mergebot] Update with Java snippet tags
[mergebot] Add melap as committer
[mergebot] Add page for the portability framework
[mergebot] Add portability to contribute section
[mergebot] Update PMC
[mergebot] [BEAM-3123] Update status of BEAM-1035 and BEAM-1037 in Nexmark.
[mergebot] Update IntelliJ Checkstyle instructions
[mergebot] Address
[mergebot] Address
[pgerver] [BEAM-3162] Add IBM Streams Runner to compatability matrix
[github] Update testing docs to account for Python.
[echauchot] Add Etienne Chauchot as a committer
[jbonofre] Update SCM URL to use gitbox instead of git-wip-us
[echauchot] [BEAM-2853] Fix left menu in nexmark page
[echauchot] [BEAM-2853] Move nexmark page to documentation/sdks/java/nexmark
[melissapa] Fix ptransform guide links to use site variable
[altay] Capabilities Matrix: Stateful processing support in Apex Runner
[relax] documentation changes for 2.2.0-RC1
[relax] Cherry pick for pr/3578
[herohde] Add links to the Go SDK
[mergebot] Add Reuven Lax as PMC member.
[mergebot] Update release date for 2.2.0 release
[melissapa] Fix broken SQL branch links
[klk] Move reporter.apache.org step to finalize section
[klk] Expand instructions for pushing release version tag
[klk] Make contribution-guide.md markdown readable
[klk] Revamp the contribution guide
[mergebot] [BEAM-3338] Add SDK specific pages to SDK left nav
[mergebot] [BEAM-3374] Fix missing/stretched images, improve alt text
[mergebot] [BEAM-2664] Make latest stable version more visible
[mergebot] Adding update to Wikipedia to release guide.
[mergebot] Fixed an example of shading the application jar to it run on Spark
[mergebot] Add link to Scio (Scala) interface.
[mergebot] Manually set hight of scala logo.
[iemejia] [BEAM-3467] Remove Java 7 from the docker development images
[melissapa] Fix broken JIRA component links
[mergebot] fix language tabs after a language specific paragraph
[melissapa] [BEAM-3117] Fix reference to bundles and windows
[jbonofre] Add 2017 look back blog post
[melissapa] Fix broken links due to code directory moves
[github] Replaces sources/sinks in programming guide with IOs
[jbonofre] Announce 2.3.0 release
[mergebot] Add blog post for the release of Beam 2.3.0
[aromanenko.dev] Fixed number of contributors and duplication of name of Alexey Romanenko
[taro.murao] Java variable names should be in CamelCase
[mergebot] Clarify runtime type checking documentation
[mergebot] Add nightly snapshot build to the release guide
[mergebot] [BEAM-3430] Update workdcount example for Java8 for Java SDK
[mergebot] Add procedure to create a self executing Jar for DataFlow
[mergebot] Don't pass the pom.xml as an input
[mergebot] Updates list of built-in IO transforms
[klk] Update Gemfile.lock
[klk] Explicitly define section id due to kramdown id generation changes
[altay] Update site to mention the 2 Python lint envs
[lcwik] [BEAM-3846] Add a link to be able to self join the Apache Beam slack
[lcwik] [BEAM-3852] Update slack channel link and slack invite for new channel.
[robertwb] Update instructions on cryptographic hashes.
[mergebot] Increase link checking timeouts
[mergebot] Update SQL doc to match new APIs
[mergebot] Update current release to 2.4.0.
[mergebot] Update download page (including signature and checksum).
[mergebot] Add instructions on how to build and use the Python tarball.
[mergebot] Update nexmark support matrix for timer and state APIs
[echauchot] Make minor fixes to Nexmark page
[echauchot] Use {{ site.release_latest }} instead of [version]
[echauchot] Make gs paths coherent for runs on dataflow runner
[mergebot] expand and collpase navigation side bar new feature
[mergebot] mark active item on navigation side bar
[melissapa] [BEAM-4026] Remove link to deleted Go SDK branch
[melissapa] parallelise test
[mergebot] [BEAM-3252] Updating contributor's guide to reference Gradle.
[mergebot] Fix project names to reflect changes required for release.
[mergebot] Drop using gradle clean in favor of --rerun-tasks
[mergebot] [BEAM-3252] Adding a step to the IntelliJ setup for gradle.
[mergebot] [BEAM-3252] Removing Annotation Processing section.
[mergebot] Stop recommending we use auto-import
[mergebot] Update checkstyle comment to correspond to the current version
[mergebot] Update instructions to run linter.
[mergebot] Change first occurance of MyOptions to PipelineOptions
[ehudm] Document Gradle command for testing Beam SDK.
[melissapa] [BEAM-4101] Fix broken links
[melissapa] Update Eclipse documentation for Gradle build.
[melissapa] [BEAM-3036] Adding Checkstyle version warning.
[melissapa] Add TODO with linked JIRA to update Docker documentation for Gradle.
[robertwb] Ignore jstorm.io to unblock presubmits.
[mergebot] Friendlier contribution guide; link to starter tasks
[mergebot] Cleanup now that GitHub is not the mirror.
[mergebot] Update contribution guide to reflect current practices.
[mergebot] Further refinement.
[mergebot] Update Nexmark launch instructions for Gradle
[lukasz.gajowy] [BEAM-4119] Update i/o testing documentation to use gradle
[mergebot] Add Jason Kuster as Committer
[github] Adding pabloem to the list of team members.
[github] Sorting by last name
[github] Adding gris as committer as well.
[mergebot] Document Java extensions for parsing Apache HTTPD logfiles and Useragent
[mergebot] Fixed some layout issues
[mergebot] Moved the 3rd party extensions to a separate page
[mergebot] [BEAM-4177] Clarify thread contraint in Programming Guide 4.3.2
[coheigea] Typo fix in the programming guide
[klk] Add "Become a Committer" with PMC guidelines
[klk] Remove Team page in favor of link to ASF roster
[klk] Remove/correct references to Team page
[klk] Do not validate links from datatorrent.com
[melissapa] Updates for Python streaming
[klk] Add top-level Community section
[klk] Remove obsolete Maturity Model section
[klk] Move Release Guide to committers section
[klk] Move committer section to the bottom (we can find it :-)
[klk] Streamline the contribution section
[klk] Google has scrapped research, now only AI
[klk] Temporarily suppress validation of ai.google links
[mergebot] Add link to portability support sheet
[valentyn] Add a Python 3 entry to the list of ongoing projects.
[mergebot] Add Go SDK quickstart and minimal documentation page
[mergebot] Add Go to the Wordcount example
[mergebot] Fix mailing list links and docker image
[github] Update index.md
[klk] Reorganize SQL documentation into sections
[swegner] Remove DoFnTester from testing guide.
[mergebot] Fix typo in becoming-a-committer docs
[timrobertson100] [BEAM-4361] Document usage of HBase TableSnapshotInputFormat
[mergebot] Add Apache Kudu IO to the planned IOs table
[mergebot] Add next Java LTS to the WIP section of the contribution guide
[mergebot] Add PubSubIO to Python IO table row
[mergebot] Change ParquetIO status in built-in I/O section
[lcwik] Add link to design docs and template to the contribution guide.
[lukasz.gajowy] Add Performance Testing to "Work in Progress" section
[marek.simunek] [BEAM-4368] add euphoria java 8 dsl documentation section
[aromanenko.dev] Added design docs page
[aromanenko.dev] Added first intro sentence.
[aromanenko.dev] Moved one doc to other section and added several new docs
[aromanenko.dev] Added more docs
[mergebot] Add SQL area to ongoing projects
[mergebot] [BEAM-4488] How to install Python SDK from source [BEAM-4489] Document
[mergebot] More changes
[mergebot] updates after review
[mergebot] Updating release guide to use Gradle commands.
[mergebot] Addressing comments. Improving commands.
[mergebot] Addressing comments. Improving commands.
[mergebot] Update release guide for publishing source zip from GitHub
[mergebot] Addressing TODOs
[mergebot] Address comments.
[mergebot] Improving.
[mergebot] Add more updates
[mergebot] More updates
[mergebot] Addressed Alan's comments
[mergebot] Add instructions about how to stage python binaries
[mergebot] copy renamed zi[ file to sdks/python/staging subdir
[mergebot] Update gradle publish with --no-parallel --no-daemon
[mergebot] Add Python Kafka to list of in-progress I/O transforms.
[echauchot] Add Etienne Chauchot's ongoing work to the contribute page.
[mergebot] [BEAM-2852] Update Nexmark documentation with Kafka support
[mergebot] [BEAM-4479] Fixed document for Coder
[swegner] Fix ErrorProne violations in fn harness and enable failOnWarnings
[swegner] fixup! Fix ErrorProne violations in fn harness and enable failOnWarnings
[swegner] Temporarily exclude website sources from RAT
[swegner] fixup! Fix ErrorProne violations in fn harness and enable failOnWarnings
[iemejia] [BEAM-4570] Use pagination in
[apilloud] [SQL] Add parse code for SET
[apilloud] [SQL] Plumb PipelineOptions through BeamRelNode
[apilloud] [SQL] Plumb PipelineOptions through BeamSqlCli
[kirpichov] Propagates artifact retrieval token in Flink runner and to the Java
[ankurgoenka] load beam fileSystems in FnHarness
[axelmagn] Implement new staging token contract in java SDK
[robertwb] Add Impulse primitive to Python SDK
[robertwb] Expand Read to Impulse | ParDo(Split) | ParDo(Read) in Python SDK
[robertwb] Fix default docker image name.
[apilloud] [SQL] Set application name to BeamSql
[apilloud] [SQL] Correctly represent pipeline
[apilloud] [SQL] Cleanup table IO functions
[apilloud] [SQL] Simplify overly verbose names
[apilloud] [SQL] Add each Calcite node to Beam graph once
[apilloud] [SQL] Seperate parse from pipeline construction
[swegner] fixup! Fix ErrorProne violations in fn harness and enable failOnWarnings
[lcwik] [BEAM-4592] Make Dataflow understand kind:varint as a well known since
[chamikara] Fixes null pointer exception on empty pubsub message data (#5016)
[lcwik] Update Dataflow container images
[robertwb] Update impulse-based read.
[kenn] Make BeamRelNode take a PCollectionList<Row> always
------------------------------------------
[...truncated 761.35 KB...]
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 5:19:06 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 5:19:06 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0620171741c5ce5950_c4b07406d0d1438fbb78006e9a6ae808_34af3974bfffc46e74b6fac77a6300bf_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 5:19:09 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 5:19:09 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0620171741c5ce5950_c4b07406d0d1438fbb78006e9a6ae808_9f64b7ad596bc12e6fb3bb96b724b5a6_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 5:19:10 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 5:19:10 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0620171741c5ce5950_c4b07406d0d1438fbb78006e9a6ae808_54e955a04778bc7653ffa45b12c1efbb_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Jun 20, 2018 5:19:14 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/apache-beam-testing/jobs
Jun 20, 2018 5:19:14 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl startJob
INFO: Failed to insert job {jobId=beam_load_mainjenkins0620171741c5ce5950_c4b07406d0d1438fbb78006e9a6ae808_4225400f7c8c5f1f426934c478aa8e65_00001_00000-0, location=US, projectId=apache-beam-testing}, will retry:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long.",
"reason" : "invalid"
} ],
"message" : "Invalid field name \"Runtime(sec)\". Fields must contain only letters, numbers, and underscores, start with a letter or underscore, and be at most 128 characters long."
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:216)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startJob(BigQueryServicesImpl.java:202)
at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.startLoadJob(BigQueryServicesImpl.java:142)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.load(WriteTables.java:269)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables.access$600(WriteTables.java:80)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn.processElement(WriteTables.java:159)
at org.apache.beam.sdk.io.gcp.bigquery.WriteTables$WriteTablesDoFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:185)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:146)
at org.apache.beam.repackaged.beam_runners_direct_java.runners.core.SimplePushbackSideInputDoFnRunner.processElementInReadyWindows(SimplePushbackSideInputDoFnRunner.java:87)
at org.apache.beam.runners.direct.ParDoEvaluator.processElement(ParDoEvaluator.java:189)
at org.apache.beam.runners.direct.DoFnLifecycleManagerRemovingTransformEvaluator.processElement(DoFnLifecycleManagerRemovingTransformEvaluator.java:55)
at org.apache.beam.runners.direct.DirectTransformExecutor.processElements(DirectTransformExecutor.java:161)
at org.apache.beam.runners.direct.DirectTransformExecutor.run(DirectTransformExecutor.java:125)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 2 mins 21.014 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 55s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/wefaic2vy6fnu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user marek.simunek@firma.seznam.cz
Not sending mail to unregistered user sourabhbajaj@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user mergebot@apache.org
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user thomas.haines@practiceinsight.io
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user ddonnelly@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user devon.meunier@shopify.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user mrtn@nrd.io
Not sending mail to unregistered user basti.lj@alibaba-inc.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user azur@paypal.com
Not sending mail to unregistered user jamalone@gmail.com
Not sending mail to unregistered user terrencehan@tencent.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user hadarh@google.com
Not sending mail to unregistered user fjp@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user pgerver@us.ibm.com
Not sending mail to unregistered user jasonkuster@google.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user taro.murao@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user wnsdud1861@gmail.com
Not sending mail to unregistered user peihe0@gmail.com
Not sending mail to unregistered user sisk@google.com
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #4
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/4/display/redirect>
------------------------------------------
[...truncated 230.43 KB...]
, 2015-07-15T00:00:09.999Z shard-00011-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00023-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
]}
Jun 19, 2018 6:17:42 PM org.apache.beam.sdk.util.MutationDetectors$CodedValueMutationDetector verifyUnmodifiedThrowingCheckedExceptions
WARNING: Coder of type class org.apache.beam.sdk.coders.KvCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element KV{null, [2015-07-15T00:00:09.999Z shard-00017-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00010-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00007-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00003-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00004-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00022-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00013-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00016-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00019-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00012-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00008-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00014-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00018-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00020-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00006-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00000-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00009-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00011-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00023-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
]}
2018-06-19T18:17:42.979Z Waiting for main pipeline to 'finish'
2018-06-19T18:17:42.979Z DONE Query10
==========================================================================================
Run started 2018-06-19T18:17:04.203Z and ran for PT38.777S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.3 23446.7 100000
0001 2.6 38328.9 92000
0002 0.9 106837.6 351
0003 2.1 47938.6 462
0004 1.2 8051.5 40
0005 3.6 27739.3 12
0006 0.6 16077.2 401
0007 9.0 11050.9 1
0008 1.1 90909.1 6000
0009 0.6 17064.8 298
0010 9.6 10467.9 1
0011 *** not run ***
0012 *** not run ***
==========================================================================================
2018-06-19T18:17:42.981Z Running query:11; exportSummaryToBigQuery:true
2018-06-19T18:17:42.982Z Generating 100000 events in batch mode
2018-06-19T18:17:45.305Z Waiting for main pipeline to 'finish'
2018-06-19T18:17:45.305Z DONE Query11
==========================================================================================
Run started 2018-06-19T18:17:04.203Z and ran for PT41.103S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.3 23446.7 100000
0001 2.6 38328.9 92000
0002 0.9 106837.6 351
0003 2.1 47938.6 462
0004 1.2 8051.5 40
0005 3.6 27739.3 12
0006 0.6 16077.2 401
0007 9.0 11050.9 1
0008 1.1 90909.1 6000
0009 0.6 17064.8 298
0010 9.6 10467.9 1
0011 2.1 47415.8 1919
0012 *** not run ***
==========================================================================================
2018-06-19T18:17:45.307Z Running query:12; exportSummaryToBigQuery:true
2018-06-19T18:17:45.308Z Generating 100000 events in batch mode
2018-06-19T18:17:46.746Z Waiting for main pipeline to 'finish'
2018-06-19T18:17:46.746Z DONE Query12
==========================================================================================
Run started 2018-06-19T18:17:04.203Z and ran for PT42.543S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.3 23446.7 100000
0001 2.6 38328.9 92000
0002 0.9 106837.6 351
0003 2.1 47938.6 462
0004 1.2 8051.5 40
0005 3.6 27739.3 12
0006 0.6 16077.2 401
0007 9.0 11050.9 1
0008 1.1 90909.1 6000
0009 0.6 17064.8 298
0010 9.6 10467.9 1
0011 2.1 47415.8 1919
0012 1.3 76982.3 1919
==========================================================================================
Exception in thread "main" ==========================================================================================
Run started 2018-06-19T18:17:04.203Z and ran for PT42.858S
java.lang.IllegalArgumentException: BigQueryIO.Write needs a GCS temp location to store temp files.
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:122)
Default configuration:
at org.apache.beam.sdk.io.gcp.bigquery.BatchLoads.validate(BatchLoads.java:194)
at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
Configurations:
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
Conf Description
at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
0000 query:0; exportSummaryToBigQuery:true
at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
0001 query:1; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
0002 query:2; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
0003 query:3; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
0005 query:5; exportSummaryToBigQuery:true
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:182)
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:102)
0007 query:7; exportSummaryToBigQuery:true
at org.apache.beam.sdk.nexmark.Main.main(Main.java:395)
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.3 23446.7 100000
0001 2.6 38328.9 92000
0002 0.9 106837.6 351
0003 2.1 47938.6 462
0004 1.2 8051.5 40
0005 3.6 27739.3 12
0006 0.6 16077.2 401
0007 9.0 11050.9 1
0008 1.1 90909.1 6000
0009 0.6 17064.8 298
0010 9.6 10467.9 1
0011 2.1 47415.8 1919
0012 1.3 76982.3 1919
==========================================================================================
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 44.523 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 31s
59 actionable tasks: 53 executed, 6 from cache
Publishing build scan...
https://gradle.com/s/nqawdi2e65upe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user jiangkai@gmail.com
Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #3
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/3/display/redirect?page=changes>
Changes:
[jiangkai] introduce optimized logic plan
[jiangkai] update
[jiangkai] fix unit tests failed
[jiangkai] address comments
[jiangkai] separate rules into sets
[jiangkai] explain plan unit tests
[jiangkai] address conflicts and comments
[jiangkai] remove volcano plan function
[jiangkai] ignore explain unit test
------------------------------------------
[...truncated 221.25 KB...]
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00018-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00014-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00012-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00017-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00020-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00009-of-00025 0 ON_TIME null
]}
Jun 19, 2018 5:37:11 PM org.apache.beam.sdk.util.MutationDetectors$CodedValueMutationDetector verifyUnmodifiedThrowingCheckedExceptions
WARNING: Coder of type class org.apache.beam.sdk.coders.KvCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element KV{null, [2015-07-15T00:00:09.999Z shard-00022-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00019-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00010-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00006-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00016-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00004-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00008-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00023-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00007-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00013-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00003-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00024-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00021-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00000-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00001-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00002-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00011-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00015-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00018-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00014-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00012-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00017-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00020-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00005-of-00025 0 ON_TIME null
, 2015-07-15T00:00:09.999Z shard-00009-of-00025 0 ON_TIME null
]}
2018-06-19T17:37:11.689Z Waiting for main pipeline to 'finish'
2018-06-19T17:37:11.689Z DONE Query10
==========================================================================================
Run started 2018-06-19T17:36:30.155Z and ran for PT41.534S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.5 22207.4 100000
0001 2.8 36350.4 92000
0002 1.0 105152.5 351
0003 2.3 43668.1 454
0004 1.3 7473.8 40
0005 4.1 24685.3 12
0006 0.7 13459.0 401
0007 9.6 10457.0 1
0008 1.2 85324.2 6000
0009 0.6 15772.9 298
0010 10.2 9771.4 1
0011 *** not run ***
0012 *** not run ***
==========================================================================================
2018-06-19T17:37:11.691Z Running query:11; exportSummaryToBigQuery:true
2018-06-19T17:37:11.692Z Generating 100000 events in batch mode
2018-06-19T17:37:14.403Z Waiting for main pipeline to 'finish'
2018-06-19T17:37:14.403Z DONE Query11
==========================================================================================
Run started 2018-06-19T17:36:30.155Z and ran for PT44.249S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.5 22207.4 100000
0001 2.8 36350.4 92000
0002 1.0 105152.5 351
0003 2.3 43668.1 454
0004 1.3 7473.8 40
0005 4.1 24685.3 12
0006 0.7 13459.0 401
0007 9.6 10457.0 1
0008 1.2 85324.2 6000
0009 0.6 15772.9 298
0010 10.2 9771.4 1
0011 2.5 39666.8 1919
0012 *** not run ***
==========================================================================================
2018-06-19T17:37:14.405Z Running query:12; exportSummaryToBigQuery:true
2018-06-19T17:37:14.406Z Generating 100000 events in batch mode
2018-06-19T17:37:15.937Z Waiting for main pipeline to 'finish'
2018-06-19T17:37:15.937Z DONE Query12
==========================================================================================
Run started 2018-06-19T17:36:30.155Z and ran for PT45.782S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
0010 query:10; exportSummaryToBigQuery:true
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.5 22207.4 100000
0001 2.8 36350.4 92000
0002 1.0 105152.5 351
0003 2.3 43668.1 454
0004 1.3 7473.8 40
0005 4.1 24685.3 12
0006 0.7 13459.0 401
0007 9.6 10457.0 1
0008 1.2 85324.2 6000
0009 0.6 15772.9 298
0010 10.2 9771.4 1
0011 2.5 39666.8 1919
0012 1.4 71225.1 1919
==========================================================================================
==========================================================================================
Exception in thread "main" Run started 2018-06-19T17:36:30.155Z and ran for PT46.124S
Default configuration:
{"debug":true,"query":0,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}
Configurations:
Conf Description
0000 query:0; exportSummaryToBigQuery:true
0001 query:1; exportSummaryToBigQuery:true
0002 query:2; exportSummaryToBigQuery:true
0003 query:3; exportSummaryToBigQuery:true
0004 query:4; exportSummaryToBigQuery:true; numEvents:10000
0005 query:5; exportSummaryToBigQuery:true
0006 query:6; exportSummaryToBigQuery:true; numEvents:10000
0007 query:7; exportSummaryToBigQuery:true
java.lang.IllegalArgumentException: BigQueryIO.Write needs a GCS temp location to store temp files.
0008 query:8; exportSummaryToBigQuery:true
0009 query:9; exportSummaryToBigQuery:true; numEvents:10000
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:122)
0010 query:10; exportSummaryToBigQuery:true
at org.apache.beam.sdk.io.gcp.bigquery.BatchLoads.validate(BatchLoads.java:194)
0011 query:11; exportSummaryToBigQuery:true
0012 query:12; exportSummaryToBigQuery:true
at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline)
0000 4.5 22207.4 100000
0001 2.8 36350.4 92000
0002 1.0 105152.5 351
0003 2.3 43668.1 454
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
0004 1.3 7473.8 40
0005 4.1 24685.3 12
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
0006 0.7 13459.0 401
0007 9.6 10457.0 1
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
0008 1.2 85324.2 6000
0009 0.6 15772.9 298
at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
0010 10.2 9771.4 1
at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
0011 2.5 39666.8 1919
at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
0012 1.4 71225.1 1919
at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
==========================================================================================
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:182)
at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:102)
at org.apache.beam.sdk.nexmark.Main.main(Main.java:395)
> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 47.954 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 23s
59 actionable tasks: 55 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/6ppz2mwefbntw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user jiangkai@gmail.com