You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/10/03 21:35:08 UTC
Build failed in Jenkins: beam_PostCommit_Python36 #629
See <https://builds.apache.org/job/beam_PostCommit_Python36/629/display/redirect?page=changes>
Changes:
[github] [BEAM-8346] Increase timeout of beam_PostRelease_Python_Candidate to
------------------------------------------
[...truncated 257.73 KB...]
"step_name": "s21"
},
"serialized_fn": "ref_AppliedPTransform_FilterOutSpammers/MapToVoidKey0_61",
"user_name": "FilterOutSpammers/MapToVoidKey0"
}
}
],
"type": "JOB_TYPE_STREAMING"
}
root: INFO: Create job: <Job
createTime: '2019-10-03T20:32:34.217997Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2019-10-03_13_32_32-8215717279263076707'
location: 'us-central1'
name: 'beamapp-jenkins-1003203221-524821'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2019-10-03T20:32:34.217997Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
root: INFO: Created job with id: [2019-10-03_13_32_32-8215717279263076707]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_32_32-8215717279263076707?project=apache-beam-testing
root: INFO: Job 2019-10-03_13_32_32-8215717279263076707 is in state JOB_STATE_RUNNING
root: INFO: 2019-10-03T20:32:36.855Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2019-10-03T20:32:37.748Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-4 in us-central1-a.
root: INFO: 2019-10-03T20:32:38.281Z: JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable parts.
root: INFO: 2019-10-03T20:32:38.284Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts.
root: INFO: 2019-10-03T20:32:38.294Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2019-10-03T20:32:38.306Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2019-10-03T20:32:38.311Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2019-10-03T20:32:38.326Z: JOB_MESSAGE_DETAILED: Expanding SplittableProcessKeyed operations into optimizable parts.
root: INFO: 2019-10-03T20:32:38.329Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into streaming Read/Write steps
root: INFO: 2019-10-03T20:32:38.351Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2019-10-03T20:32:38.380Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2019-10-03T20:32:38.385Z: JOB_MESSAGE_DETAILED: Fusing consumer WindowIntoFixedWindows into AddEventTimestamps
root: INFO: 2019-10-03T20:32:38.387Z: JOB_MESSAGE_DETAILED: Fusing consumer ExtractUserScores into AddEventTimestamps
root: INFO: 2019-10-03T20:32:38.390Z: JOB_MESSAGE_DETAILED: Fusing consumer WindowIntoSessions into ExtractUserScores
root: INFO: 2019-10-03T20:32:38.392Z: JOB_MESSAGE_DETAILED: Fusing consumer UserFixedWindows into ExtractUserScores
root: INFO: 2019-10-03T20:32:38.394Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/Values into CalculateSpammyUsers/SumUsersScores/Combine
root: INFO: 2019-10-03T20:32:38.396Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/ProcessAndFilter/MapToVoidKey0 into CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/UnKey
root: INFO: 2019-10-03T20:32:38.399Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/ProcessAndFilter/MapToVoidKey0 into CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/UnKey
root: INFO: 2019-10-03T20:32:38.401Z: JOB_MESSAGE_DETAILED: Fusing consumer FilterOutSpammers/MapToVoidKey0 into CreateSpammersView/UnKey
root: INFO: 2019-10-03T20:32:38.403Z: JOB_MESSAGE_DETAILED: Fusing consumer FilterOutSpammers/MapToVoidKey0 into CreateSpammersView/UnKey
root: INFO: 2019-10-03T20:32:38.405Z: JOB_MESSAGE_DETAILED: Fusing consumer DecodeString into ReadPubSub/Read
root: INFO: 2019-10-03T20:32:38.407Z: JOB_MESSAGE_DETAILED: Fusing consumer ParseGameEventFn into DecodeString
root: INFO: 2019-10-03T20:32:38.410Z: JOB_MESSAGE_DETAILED: Fusing consumer AddEventTimestamps into ParseGameEventFn
root: INFO: 2019-10-03T20:32:38.412Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/SumUsersScores/GroupByKey/WriteStream into UserFixedWindows
root: INFO: 2019-10-03T20:32:38.414Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/SumUsersScores/GroupByKey/MergeBuckets into CalculateSpammyUsers/SumUsersScores/GroupByKey/ReadStream
root: INFO: 2019-10-03T20:32:38.416Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/SumUsersScores/Combine into CalculateSpammyUsers/SumUsersScores/GroupByKey/MergeBuckets
root: INFO: 2019-10-03T20:32:38.418Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/KeyWithVoid into CalculateSpammyUsers/Values
root: INFO: 2019-10-03T20:32:38.420Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/WriteStream into CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/KeyWithVoid
root: INFO: 2019-10-03T20:32:38.422Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/MergeBuckets into CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/ReadStream
root: INFO: 2019-10-03T20:32:38.424Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/CombinePerKey/Combine into CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/MergeBuckets
root: INFO: 2019-10-03T20:32:38.426Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/UnKey into CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/CombinePerKey/Combine
root: INFO: 2019-10-03T20:32:38.428Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey into CalculateSpammyUsers/ProcessAndFilter/MapToVoidKey0
root: INFO: 2019-10-03T20:32:38.431Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream into CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey
root: INFO: 2019-10-03T20:32:38.433Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets into CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream
root: INFO: 2019-10-03T20:32:38.435Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/Values into CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets
root: INFO: 2019-10-03T20:32:38.437Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter into CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/Values
root: INFO: 2019-10-03T20:32:38.439Z: JOB_MESSAGE_DETAILED: Fusing consumer CreateSpammersView/KeyWithVoid into CalculateSpammyUsers/ProcessAndFilter/ProcessAndFilter
root: INFO: 2019-10-03T20:32:38.442Z: JOB_MESSAGE_DETAILED: Fusing consumer CreateSpammersView/CombinePerKey/GroupByKey/WriteStream into CreateSpammersView/KeyWithVoid
root: INFO: 2019-10-03T20:32:38.444Z: JOB_MESSAGE_DETAILED: Fusing consumer CreateSpammersView/CombinePerKey/GroupByKey/MergeBuckets into CreateSpammersView/CombinePerKey/GroupByKey/ReadStream
root: INFO: 2019-10-03T20:32:38.447Z: JOB_MESSAGE_DETAILED: Fusing consumer CreateSpammersView/CombinePerKey/Combine into CreateSpammersView/CombinePerKey/GroupByKey/MergeBuckets
root: INFO: 2019-10-03T20:32:38.449Z: JOB_MESSAGE_DETAILED: Fusing consumer CreateSpammersView/UnKey into CreateSpammersView/CombinePerKey/Combine
root: INFO: 2019-10-03T20:32:38.451Z: JOB_MESSAGE_DETAILED: Fusing consumer FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey into FilterOutSpammers/MapToVoidKey0
root: INFO: 2019-10-03T20:32:38.453Z: JOB_MESSAGE_DETAILED: Fusing consumer FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream into FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey
root: INFO: 2019-10-03T20:32:38.455Z: JOB_MESSAGE_DETAILED: Fusing consumer FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets into FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream
root: INFO: 2019-10-03T20:32:38.457Z: JOB_MESSAGE_DETAILED: Fusing consumer FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/Values into FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets
root: INFO: 2019-10-03T20:32:38.459Z: JOB_MESSAGE_DETAILED: Fusing consumer FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter into FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/Values
root: INFO: 2019-10-03T20:32:38.462Z: JOB_MESSAGE_DETAILED: Fusing consumer ExtractAndSumScore/Map(<lambda at game_stats.py:142>) into FilterOutSpammers/FilterOutSpammers
root: INFO: 2019-10-03T20:32:38.464Z: JOB_MESSAGE_DETAILED: Fusing consumer ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/WriteStream into ExtractAndSumScore/Map(<lambda at game_stats.py:142>)
root: INFO: 2019-10-03T20:32:38.466Z: JOB_MESSAGE_DETAILED: Fusing consumer ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/MergeBuckets into ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/ReadStream
root: INFO: 2019-10-03T20:32:38.468Z: JOB_MESSAGE_DETAILED: Fusing consumer ExtractAndSumScore/CombinePerKey(sum)/Combine into ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/MergeBuckets
root: INFO: 2019-10-03T20:32:38.470Z: JOB_MESSAGE_DETAILED: Fusing consumer TeamScoresDict into ExtractAndSumScore/CombinePerKey(sum)/Combine
root: INFO: 2019-10-03T20:32:38.472Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/ConvertToRow into TeamScoresDict
root: INFO: 2019-10-03T20:32:38.475Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/AppendDestination into WriteTeamScoreSums/ConvertToRow
root: INFO: 2019-10-03T20:32:38.477Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn) into WriteTeamScoreSums/WriteToBigQuery/AppendDestination
root: INFO: 2019-10-03T20:32:38.479Z: JOB_MESSAGE_DETAILED: Fusing consumer CombinePerKey(<lambda at game_stats.py:380>)/GroupByKey/WriteStream into WindowIntoSessions
root: INFO: 2019-10-03T20:32:38.481Z: JOB_MESSAGE_DETAILED: Fusing consumer CombinePerKey(<lambda at game_stats.py:380>)/GroupByKey/MergeBuckets into CombinePerKey(<lambda at game_stats.py:380>)/GroupByKey/ReadStream
root: INFO: 2019-10-03T20:32:38.483Z: JOB_MESSAGE_DETAILED: Fusing consumer CombinePerKey(<lambda at game_stats.py:380>)/Combine into CombinePerKey(<lambda at game_stats.py:380>)/GroupByKey/MergeBuckets
root: INFO: 2019-10-03T20:32:38.485Z: JOB_MESSAGE_DETAILED: Fusing consumer UserSessionActivity into CombinePerKey(<lambda at game_stats.py:380>)/Combine
root: INFO: 2019-10-03T20:32:38.488Z: JOB_MESSAGE_DETAILED: Fusing consumer WindowToExtractSessionMean into UserSessionActivity
root: INFO: 2019-10-03T20:32:38.490Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(MeanCombineFn)/KeyWithVoid into WindowToExtractSessionMean
root: INFO: 2019-10-03T20:32:38.492Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/WriteStream into CombineGlobally(MeanCombineFn)/KeyWithVoid
root: INFO: 2019-10-03T20:32:38.494Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/MergeBuckets into CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/ReadStream
root: INFO: 2019-10-03T20:32:38.496Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(MeanCombineFn)/CombinePerKey/Combine into CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/MergeBuckets
root: INFO: 2019-10-03T20:32:38.498Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(MeanCombineFn)/UnKey into CombineGlobally(MeanCombineFn)/CombinePerKey/Combine
root: INFO: 2019-10-03T20:32:38.500Z: JOB_MESSAGE_DETAILED: Fusing consumer FormatAvgSessionLength into CombineGlobally(MeanCombineFn)/UnKey
root: INFO: 2019-10-03T20:32:38.502Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteAvgSessionLength/ConvertToRow into FormatAvgSessionLength
root: INFO: 2019-10-03T20:32:38.504Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteAvgSessionLength/WriteToBigQuery/AppendDestination into WriteAvgSessionLength/ConvertToRow
root: INFO: 2019-10-03T20:32:38.506Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteAvgSessionLength/WriteToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn) into WriteAvgSessionLength/WriteToBigQuery/AppendDestination
root: INFO: 2019-10-03T20:32:38.538Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2019-10-03T20:32:38.566Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2019-10-03T20:32:38.579Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2019-10-03T20:32:38.765Z: JOB_MESSAGE_DEBUG: Executing wait step start2
root: INFO: 2019-10-03T20:32:38.778Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2019-10-03T20:32:38.784Z: JOB_MESSAGE_BASIC: Starting 1 workers...
root: INFO: 2019-10-03T20:32:42.161Z: JOB_MESSAGE_BASIC: Executing operation CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/ReadStream+CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/MergeBuckets+CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/CombinePerKey/Combine+CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/UnKey+CalculateSpammyUsers/ProcessAndFilter/MapToVoidKey0+CalculateSpammyUsers/ProcessAndFilter/MapToVoidKey0+CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream
root: INFO: 2019-10-03T20:32:42.167Z: JOB_MESSAGE_BASIC: Executing operation CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/ReadStream+CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/MergeBuckets+CombineGlobally(MeanCombineFn)/CombinePerKey/Combine+CombineGlobally(MeanCombineFn)/UnKey+FormatAvgSessionLength+WriteAvgSessionLength/ConvertToRow+WriteAvgSessionLength/WriteToBigQuery/AppendDestination+WriteAvgSessionLength/WriteToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)
root: INFO: 2019-10-03T20:32:42.167Z: JOB_MESSAGE_BASIC: Executing operation ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/ReadStream+ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/MergeBuckets+ExtractAndSumScore/CombinePerKey(sum)/Combine+TeamScoresDict+WriteTeamScoreSums/ConvertToRow+WriteTeamScoreSums/WriteToBigQuery/AppendDestination+WriteTeamScoreSums/WriteToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)
root: INFO: 2019-10-03T20:32:42.167Z: JOB_MESSAGE_BASIC: Executing operation CalculateSpammyUsers/SumUsersScores/GroupByKey/ReadStream+CalculateSpammyUsers/SumUsersScores/GroupByKey/MergeBuckets+CalculateSpammyUsers/SumUsersScores/Combine+CalculateSpammyUsers/Values+CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/KeyWithVoid+CalculateSpammyUsers/CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/WriteStream+CalculateSpammyUsers/SumUsersScores/Combine.out/FromValue/WriteStream
root: INFO: 2019-10-03T20:32:42.167Z: JOB_MESSAGE_BASIC: Executing operation CreateSpammersView/CombinePerKey/GroupByKey/ReadStream+CreateSpammersView/CombinePerKey/GroupByKey/MergeBuckets+CreateSpammersView/CombinePerKey/Combine+CreateSpammersView/UnKey+FilterOutSpammers/MapToVoidKey0+FilterOutSpammers/MapToVoidKey0+FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream
root: INFO: 2019-10-03T20:32:42.167Z: JOB_MESSAGE_BASIC: Executing operation CalculateSpammyUsers/SumUsersScores/Combine.out/FromValue/ReadStream+CalculateSpammyUsers/ProcessAndFilter/ProcessAndFilter+CreateSpammersView/KeyWithVoid+CreateSpammersView/CombinePerKey/GroupByKey/WriteStream
root: INFO: 2019-10-03T20:32:42.167Z: JOB_MESSAGE_BASIC: Executing operation CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream+CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets+CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/Values+CalculateSpammyUsers/ProcessAndFilter/_UnpickledSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter
root: INFO: 2019-10-03T20:32:42.167Z: JOB_MESSAGE_BASIC: Executing operation CombinePerKey(<lambda at game_stats.py:380>)/GroupByKey/ReadStream+CombinePerKey(<lambda at game_stats.py:380>)/GroupByKey/MergeBuckets+CombinePerKey(<lambda at game_stats.py:380>)/Combine+UserSessionActivity+WindowToExtractSessionMean+CombineGlobally(MeanCombineFn)/KeyWithVoid+CombineGlobally(MeanCombineFn)/CombinePerKey/GroupByKey/WriteStream
root: INFO: 2019-10-03T20:32:42.168Z: JOB_MESSAGE_BASIC: Executing operation ReadPubSub/Read+DecodeString+ParseGameEventFn+AddEventTimestamps+WindowIntoFixedWindows+ExtractUserScores+WindowIntoSessions+UserFixedWindows+CalculateSpammyUsers/SumUsersScores/GroupByKey/WriteStream+CombinePerKey(<lambda at game_stats.py:380>)/GroupByKey/WriteStream+WindowIntoFixedWindows.out/FromValue/WriteStream
root: INFO: 2019-10-03T20:32:42.170Z: JOB_MESSAGE_BASIC: Executing operation FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream+FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets+FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/Values+FilterOutSpammers/_UnpickledSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter
root: INFO: 2019-10-03T20:32:42.172Z: JOB_MESSAGE_BASIC: Executing operation WindowIntoFixedWindows.out/FromValue/ReadStream+FilterOutSpammers/FilterOutSpammers+ExtractAndSumScore/Map(<lambda at game_stats.py:142>)+ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/WriteStream
root: INFO: 2019-10-03T20:33:08.749Z: JOB_MESSAGE_DEBUG: Executing input step topology_init_attach_disk_input_step
root: INFO: 2019-10-03T20:33:09.065Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2019-10-03T20:33:09.744Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-4 in us-central1-a.
root: INFO: 2019-10-03T20:33:32.182Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2019-10-03T20:39:08.956Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: WARNING: Timing out on waiting for job 2019-10-03_13_32_32-8215717279263076707 after 724 seconds
root: INFO: Attempting to perform query SELECT mean_duration FROM `apache-beam-testing.game_stats_it_dataset15701347392817.game_stats_sessions` WHERE mean_duration=300 LIMIT 1 to BQ
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
urllib3.util.retry: DEBUG: Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 181
urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): www.googleapis.com:443
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "POST /bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/queries/1f68b277-3081-4e24-8101-a29ac6a7c30f?maxResults=0&timeoutMs=10000&location=US HTTP/1.1" 200 None
google.api_core.retry: DEBUG: Retrying due to , sleeping 1.1s ...
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/queries/1f68b277-3081-4e24-8101-a29ac6a7c30f?maxResults=0&timeoutMs=10000&location=US HTTP/1.1" 200 None
google.api_core.retry: DEBUG: Retrying due to , sleeping 3.7s ...
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/queries/1f68b277-3081-4e24-8101-a29ac6a7c30f?maxResults=0&timeoutMs=10000&location=US HTTP/1.1" 200 None
google.api_core.retry: DEBUG: Retrying due to , sleeping 7.4s ...
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/queries/1f68b277-3081-4e24-8101-a29ac6a7c30f?maxResults=0&timeoutMs=10000&location=US HTTP/1.1" 200 None
google.api_core.retry: DEBUG: Retrying due to , sleeping 11.2s ...
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/queries/1f68b277-3081-4e24-8101-a29ac6a7c30f?maxResults=0&timeoutMs=10000&location=US HTTP/1.1" 200 None
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
urllib3.util.retry: DEBUG: Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 181
urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): www.googleapis.com:443
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "DELETE /bigquery/v2/projects/apache-beam-testing/datasets/game_stats_it_dataset15701347392817?deleteContents=true HTTP/1.1" 204 0
--------------------- >> end captured logging << ---------------------
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1145: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_32_32-8215717279263076707?project=apache-beam-testing
experiments = p.options.view_as(DebugOptions).experiments or []
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_49_31-13463608335211281308?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_59_16-376604534769447903?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_09_24-13036022286306871689?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_18_12-10192859550502171006?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_32_29-7941537762003077885?project=apache-beam-testing
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:695: BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead.
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_57_34-5230371144285087221?project=apache-beam-testing
kms_key=transform.kms_key))
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_07_39-6296483116371385893?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_17_45-6670604138136809604?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_32_31-13480967516439931774?project=apache-beam-testing
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1145: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_46_49-15673089918644259891?project=apache-beam-testing
experiments = p.options.view_as(DebugOptions).experiments or []
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_56_45-37909981107068806?project=apache-beam-testing
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:793: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_06_31-18173517567633113005?project=apache-beam-testing
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_17_09-14621892886386691351?project=apache-beam-testing
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/fileio_test.py>:232: FutureWarning: MatchAll is experimental.
| 'GetPath' >> beam.Map(lambda metadata: metadata.path))
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/fileio_test.py>:243: FutureWarning: MatchAll is experimental.
| 'Checksums' >> beam.Map(compute_hash))
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/fileio_test.py>:243: FutureWarning: ReadMatches is experimental.
| 'Checksums' >> beam.Map(compute_hash))
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_32_30-6881921757423649078?project=apache-beam-testing
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:577: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_53_24-8309540224849512361?project=apache-beam-testing
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_04_43-9929608441593570680?project=apache-beam-testing
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1145: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_13_17-13551307586627431083?project=apache-beam-testing
experiments = p.options.view_as(DebugOptions).experiments or []
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_32_29-8743440329997332465?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_42_48-3187329306530561067?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_57_36-10230460002353358974?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_15_47-17857573477894501229?project=apache-beam-testing
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_32_27-16603046940138269448?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_43_21-8637154053656373696?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_52_53-11325311341291862678?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_02_47-8871682534184699843?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_12_28-5765780020647373600?project=apache-beam-testing
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:695: BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead.
kms_key=transform.kms_key))
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py>:73: BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead.
kms_key=kms_key))
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1145: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_32_29-17221674877862397795?project=apache-beam-testing
experiments = p.options.view_as(DebugOptions).experiments or []
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_43_53-8729701604698374004?project=apache-beam-testing
<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:793: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_57_08-16677109039911440106?project=apache-beam-testing
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_07_44-9008780984914721706?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_32_35-6988350142550100574?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_42_56-13993539669038572449?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_13_52_49-15011081009909705346?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_04_26-16090934759274983226?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_15_50-15538275938930174626?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-10-03_14_25_57-9171917877314141532?project=apache-beam-testing
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py36.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 45 tests in 3772.180s
FAILED (SKIP=6, errors=1)
> Task :sdks:python:test-suites:dataflow:py36:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/dataflow/py36/build.gradle'> line: 56
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py36:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 56s
64 actionable tasks: 47 executed, 17 from cache
Publishing build scan...
https://gradle.com/s/nls4kzvhubpsg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python36 #630
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python36/630/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org