You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/11/16 06:09:18 UTC

Build failed in Jenkins: beam_PostCommit_Java_Nexmark_Direct #1143

See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/1143/display/redirect>

------------------------------------------
[...truncated 486.29 KB...]
  0004           1.7                      5793.7                          40              
  0005           6.3                     15780.3                          12              
  0006           1.1                      8881.0                         401              
  0007          82.9                      1206.0                           1              
  0008           2.2                     45454.5                        6000              
  0009           0.9                     11376.6                         298              
  0010          71.0                      1408.5                           1              
  0011  *** not run ***
  0012  *** not run ***
  0013  *** not run ***
==========================================================================================

2018-11-16T06:09:02.245Z Generating 100000 events in streaming mode
2018-11-16T06:09:06.160Z Waiting for main pipeline to 'finish'
2018-11-16T06:09:06.160Z DONE Query11
2018-11-16T06:09:06.160Z 1 samples not enough to calculate steady-state event rate
Nov 16, 2018 6:09:06 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace Query11
2018-11-16T06:09:06.161Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true

==========================================================================================
Run started 2018-11-16T06:05:58.113Z and ran for PT188.048S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; exportSummaryToBigQuery:true
  0001  query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
  0002  query:SELECTION; exportSummaryToBigQuery:true
  0003  query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000
  0005  query:HOT_ITEMS; exportSummaryToBigQuery:true
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000
  0007  query:HIGHEST_BID; exportSummaryToBigQuery:true
  0008  query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
  0011  query:USER_SESSIONS; exportSummaryToBigQuery:true
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
  0013  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000           6.1                     16474.5                      100000              
  0001           3.7                     27240.5                       92000              
  0002           1.8                     56053.8                         351              
  0003           3.7                     27100.3                         445              
  0004           1.7                      5793.7                          40              
  0005           6.3                     15780.3                          12              
  0006           1.1                      8881.0                         401              
  0007          82.9                      1206.0                           1              
  0008           2.2                     45454.5                        6000              
  0009           0.9                     11376.6                         298              
  0010          71.0                      1408.5                           1              
  0011           3.8                     26267.4                        1919              
  0012  *** not run ***
  0013  *** not run ***
==========================================================================================

2018-11-16T06:09:06.162Z Generating 100000 events in streaming mode
2018-11-16T06:09:09.402Z Waiting for main pipeline to 'finish'
2018-11-16T06:09:09.402Z DONE Query12
2018-11-16T06:09:09.403Z 1 samples not enough to calculate steady-state event rate
Nov 16, 2018 6:09:09 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
2018-11-16T06:09:09.403Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
SEVERE: Failed to get metric fatal, from namespace Query12

==========================================================================================
Run started 2018-11-16T06:05:58.113Z and ran for PT191.290S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; exportSummaryToBigQuery:true
  0001  query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
  0002  query:SELECTION; exportSummaryToBigQuery:true
  0003  query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000
  0005  query:HOT_ITEMS; exportSummaryToBigQuery:true
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000
  0007  query:HIGHEST_BID; exportSummaryToBigQuery:true
  0008  query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
  0011  query:USER_SESSIONS; exportSummaryToBigQuery:true
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
  0013  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000           6.1                     16474.5                      100000              
  0001           3.7                     27240.5                       92000              
  0002           1.8                     56053.8                         351              
  0003           3.7                     27100.3                         445              
  0004           1.7                      5793.7                          40              
  0005           6.3                     15780.3                          12              
  0006           1.1                      8881.0                         401              
  0007          82.9                      1206.0                           1              
  0008           2.2                     45454.5                        6000              
  0009           0.9                     11376.6                         298              
  0010          71.0                      1408.5                           1              
  0011           3.8                     26267.4                        1919              
  0012           3.1                     31826.9                        1919              
  0013  *** not run ***
==========================================================================================

2018-11-16T06:09:09.405Z Generating 100000 events in streaming mode
2018-11-16T06:09:12.861Z Waiting for main pipeline to 'finish'
2018-11-16T06:09:12.861Z DONE JoinToFiles
2018-11-16T06:09:12.862Z 1 samples not enough to calculate steady-state event rate
Nov 16, 2018 6:09:12 AM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric fatal, from namespace JoinToFiles

==========================================================================================
Run started 2018-11-16T06:05:58.113Z and ran for PT194.749S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}

Configurations:
  Conf  Description
  0000  query:PASSTHROUGH; exportSummaryToBigQuery:true
  0001  query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
  0002  query:SELECTION; exportSummaryToBigQuery:true
  0003  query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000
  0005  query:HOT_ITEMS; exportSummaryToBigQuery:true
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000
  0007  query:HIGHEST_BID; exportSummaryToBigQuery:true
  0008  query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
  0011  query:USER_SESSIONS; exportSummaryToBigQuery:true
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
  0013  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true

Performance:
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
  0000           6.1                     16474.5                      100000              
  0001           3.7                     27240.5                       92000              
  0002           1.8                     56053.8                         351              
  0003           3.7                     27100.3                         445              
  0004           1.7                      5793.7                          40              
  0005           6.3                     15780.3                          12              
  0006           1.1                      8881.0                         401              
  0007          82.9                      1206.0                           1              
  0008           2.2                     45454.5                        6000              
  0009           0.9                     11376.6                         298              
  0010          71.0                      1408.5                           1              
  0011           3.8                     26267.4                        1919              
  0012           3.1                     31826.9                        1919              
  0013           3.4                     29761.9                       92000              
==========================================================================================


==========================================================================================
Run started 2018-11-16T06:05:58.113Z and ran for PT197.194S

Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1}

Configurations:
  Conf  Description
Exception in thread "main"   0000  query:PASSTHROUGH; exportSummaryToBigQuery:true
  0001  query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
  0002  query:SELECTION; exportSummaryToBigQuery:true
  0003  query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
  0004  query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:10000
  0005  query:HOT_ITEMS; exportSummaryToBigQuery:true
  0006  query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:10000
  0007  query:HIGHEST_BID; exportSummaryToBigQuery:true
  0008  query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
  0009  query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
  0010  query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
java.lang.NullPointerException
  0011  query:USER_SESSIONS; exportSummaryToBigQuery:true
  0012  query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
	at com.google.cloud.bigquery.StandardTableDefinition$StreamingBuffer.fromPb(StandardTableDefinition.java:116)
  0013  query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
	at com.google.cloud.bigquery.StandardTableDefinition.fromPb(StandardTableDefinition.java:225)

	at com.google.cloud.bigquery.TableDefinition.fromPb(TableDefinition.java:155)
Performance:
	at com.google.cloud.bigquery.TableInfo$BuilderImpl.<init>(TableInfo.java:183)
  Conf  Runtime(sec)    (Baseline)  Events(/sec)    (Baseline)       Results    (Baseline)
	at com.google.cloud.bigquery.Table.fromPb(Table.java:593)
  0000           6.1                     16474.5                      100000              
	at com.google.cloud.bigquery.BigQueryImpl.getTable(BigQueryImpl.java:410)
  0001           3.7                     27240.5                       92000              
	at org.apache.beam.sdk.testutils.publishing.BigQueryClient.createTableIfNotExists(BigQueryClient.java:74)
  0002           1.8                     56053.8                         351              
	at org.apache.beam.sdk.nexmark.Main.savePerfsToBigQuery(Main.java:184)
  0003           3.7                     27100.3                         445              
	at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:148)
  0004           1.7                      5793.7                          40              
	at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:98)
  0005           6.3                     15780.3                          12              
	at org.apache.beam.sdk.nexmark.Main.main(Main.java:423)
  0006           1.1                      8881.0                         401              
  0007          82.9                      1206.0                           1              
  0008           2.2                     45454.5                        6000              
  0009           0.9                     11376.6                         298              
  0010          71.0                      1408.5                           1              
  0011           3.8                     26267.4                        1919              
  0012           3.1                     31826.9                        1919              
  0013           3.4                     29761.9                       92000              
==========================================================================================


> Task :beam-sdks-java-nexmark:run FAILED
:beam-sdks-java-nexmark:run (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 3 mins 19.309 secs.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':beam-sdks-java-nexmark:run'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_191/bin/java'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 50s
65 actionable tasks: 14 executed, 51 up-to-date

Publishing build scan...
https://gradle.com/s/4h2r72cyxqpc4

Build cache (/home/jenkins/.gradle/caches/build-cache-1) removing files not accessed on or after Fri Nov 09 06:04:30 UTC 2018.
Cache entries evicted. In-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin: Size{4311} MaxSize{4500}, CacheStats{hitCount=3, missCount=3998, loadSuccessCount=3999, loadExceptionCount=0, totalLoadTime=207497380, evictionCount=1} 
Performance may suffer from in-memory cache misses. Increase max heap size of Gradle build process to reduce cache misses.
Cache entries evicted. In-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin: Size{4500} MaxSize{4500}, CacheStats{hitCount=3, missCount=4637, loadSuccessCount=4638, loadExceptionCount=0, totalLoadTime=239953428, evictionCount=451} 
Performance may suffer from in-memory cache misses. Increase max heap size of Gradle build process to reduce cache misses.
Cache entries evicted. In-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin: Size{4500} MaxSize{4500}, CacheStats{hitCount=3, missCount=5087, loadSuccessCount=5088, loadExceptionCount=0, totalLoadTime=259783903, evictionCount=901} 
Performance may suffer from in-memory cache misses. Increase max heap size of Gradle build process to reduce cache misses.
Cache entries evicted. In-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin: Size{4500} MaxSize{4500}, CacheStats{hitCount=3, missCount=5537, loadSuccessCount=5538, loadExceptionCount=0, totalLoadTime=278410281, evictionCount=1351} 
Performance may suffer from in-memory cache misses. Increase max heap size of Gradle build process to reduce cache misses.
Build cache (/home/jenkins/.gradle/caches/build-cache-1) cleaned up in 0.468 secs.
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Java_Nexmark_Direct #1144

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/1144/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org