You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2019/11/19 16:26:00 UTC
[jira] [Work logged] (BEAM-8737) beam_Dependency_Check is missing
bigtable-client-core as high priority items
[ https://issues.apache.org/jira/browse/BEAM-8737?focusedWorklogId=346075&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-346075 ]
ASF GitHub Bot logged work on BEAM-8737:
----------------------------------------
Author: ASF GitHub Bot
Created on: 19/Nov/19 16:25
Start Date: 19/Nov/19 16:25
Worklog Time Spent: 10m
Work Description: suztomo commented on pull request #10155: [BEAM-8737] Incorporate TRIAGE NEEDED status in beam_Dependency_Check
URL: https://github.com/apache/beam/pull/10155
https://issues.apache.org/jira/projects/BEAM/issues/BEAM-8737
As of now weekly beam_Dependency_Check job throws exception for JIRA tickets marked as "TRIAGE NEEDED", failing to include corresponding dependencies into email. This PR fixes this.
Example log: https://builds.apache.org/job/beam_Dependency_Check/237/
```
15:43:02 Start processing: - com.google.cloud.bigtable:bigtable-client-core [1.8.0 -> 1.12.1]
15:43:02
15:43:02 INFO:root:Finding release date of com.google.cloud.bigtable:bigtable-client-core 1.8.0 from the Maven Central
15:43:02 INFO:root:Finding release date of com.google.cloud.bigtable:bigtable-client-core 1.12.1 from the Maven Central
15:43:03 INFO:root:Start handling the JIRA issues for Java dependency: com.google.cloud.bigtable:bigtable-client-core 1.12.1
15:43:04 INFO:root:The parent issue BEAM-8690 is not opening. Attempt reopening the issue
15:43:04 Traceback (most recent call last):
15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/.test-infra/jenkins/jira_utils/jira_manager.py", line 90, in run
15:43:04 self.jira.reopen_issue(parent_issue)
15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/.test-infra/jenkins/jira_utils/jira_client.py", line 130, in reopen_issue
15:43:04 self.jira.transition_issue(issue.key, 3)
15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/dependency/check/lib/python3.5/site-packages/jira/client.py", line 126, in wrapper
15:43:04 result = func(*arg_list, **kwargs)
15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/dependency/check/lib/python3.5/site-packages/jira/client.py", line 1578, in transition_issue
15:43:04 url, data=json.dumps(data))
15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/dependency/check/lib/python3.5/site-packages/jira/resilientsession.py", line 154, in post
15:43:04 return self.__verb('POST', url, **kwargs)
15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/dependency/check/lib/python3.5/site-packages/jira/resilientsession.py", line 147, in __verb
15:43:04 raise_on_error(response, verb=verb, **kwargs)
15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/dependency/check/lib/python3.5/site-packages/jira/resilientsession.py", line 57, in raise_on_error
15:43:04 r.status_code, error, r.url, request=request, response=r, **kwargs)
15:43:04 jira.exceptions.JIRAError: JiraError HTTP 400 url: https://issues.apache.org/jira/rest/api/2/issue/BEAM-8690/transitions
15:43:04 text: It seems that you have tried to perform a workflow operation (Reopen Issue) that is not valid for the current state of this issue (BEAM-8690). The likely cause is that somebody has changed the issue recently, please look at the issue history for details.
15:43:04
15:43:04 response headers = {'X-AREQUESTID': '1243x60347388x3', 'Date': 'Mon, 18 Nov 2019 20:43:04 GMT', 'X-AUSERNAME': ****, 'Cache-Control': 'no-cache, no-store, no-transform', 'Server': 'Apache', 'Connection': 'close', 'X-XSS-Protection': '1; mode=block', 'Content-Type': 'application/json;charset=UTF-8', 'Content-Security-Policy': "frame-ancestors 'self'", 'Transfer-Encoding': 'chunked', 'X-Frame-Options': 'SAMEORIGIN', 'X-ASEN': 'SEN-2062203', 'X-Seraph-LoginReason': 'OK', 'X-Content-Type-Options': 'nosniff', 'X-ASESSIONID': '877oha'}
15:43:04 response text = {"errorMessages":["It seems that you have tried to perform a workflow operation (Reopen Issue) that is not valid for the current state of this issue (BEAM-8690). The likely cause is that somebody has changed the issue recently, please look at the issue history for details."],"errors":{}}
15:43:04 ERROR:root:Failed reopening the parent issue BEAM-8690.
15:43:04 Stop handling the JIRA issue for com.google.cloud.bigtable:bigtable-client-core, 1.12.1
15:43:04 Traceback (most recent call last):
15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/.test-infra/jenkins/dependency_check/dependency_check_report_generator.py", line 143, in prioritize_dependencies
15:43:04 if (jira_issue.fields.status.name == 'Open' or
15:43:04 AttributeError: 'NoneType' object has no attribute 'fields'
```
The ticket it tried to reopen was https://issues.apache.org/jira/projects/BEAM/issues/BEAM-8690, which has "TRIAGE NEEDED" status.
------------------------
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
- [ ] [**Choose reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and mention them in a comment (`R: @username`).
- [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
- [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
See the [Contributor Guide](https://beam.apache.org/contribute) for more tips on [how to make review process smoother](https://beam.apache.org/contribute/#make-reviewers-job-easier).
Post-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
--- | --- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/)
Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python2/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python35/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python36/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python37/lastCompletedBuild/) | --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python35_VR_Flink/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/lastCompletedBuild/)
XLang | --- | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_XVR_Flink/lastCompletedBuild/) | --- | --- | ---
Pre-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
--- |Java | Python | Go | Website
--- | --- | --- | --- | ---
Non-portable | [](https://builds.apache.org/job/beam_PreCommit_Java_Cron/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PreCommit_Python_Cron/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PreCommit_PythonLint_Cron/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PreCommit_Go_Cron/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PreCommit_Website_Cron/lastCompletedBuild/)
Portable | --- | [](https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/lastCompletedBuild/) | --- | ---
See [.test-infra/jenkins/README](https://github.com/apache/beam/blob/master/.test-infra/jenkins/README.md) for trigger phrase, status and link of all Jenkins jobs.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 346075)
Remaining Estimate: 0h
Time Spent: 10m
> beam_Dependency_Check is missing bigtable-client-core as high priority items
> ----------------------------------------------------------------------------
>
> Key: BEAM-8737
> URL: https://issues.apache.org/jira/browse/BEAM-8737
> Project: Beam
> Issue Type: Bug
> Components: build-system
> Reporter: Tomo Suzuki
> Assignee: Tomo Suzuki
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> beam_Dependency_Check is missing high priority items such as bigtable-client-core.
> For example, https://builds.apache.org/job/beam_Dependency_Check/235/consoleFull sent email but the email did not contain bigtable-client-core. The current version 1.8.0 is 4-minor-version older than the latest 1.12.1.
> Initially I was suspecting the line with {{high_priority_deps.append}}:
> {noformat}
> if (version_comparer.compare_dependency_versions(curr_ver, latest_ver) or
> compare_dependency_release_dates(curr_release_date, latest_release_date)):
> # Create a new issue or update on the existing issue
> jira_issue = jira_manager.run(dep_name, curr_ver, latest_ver, sdk_type, group_id = group_id)
> if (jira_issue.fields.status.name == 'Open' or
> jira_issue.fields.status.name == 'Reopened'):
> dep_info += "<td><a href=\'{0}\'>{1}</a></td></tr>".format(
> ReportGeneratorConfig.BEAM_JIRA_HOST+"browse/"+ jira_issue.key,
> jira_issue.key)
> high_priority_deps.append(dep_info)
> {noformat}
> and 2nd run would include the artifact in the email. But it did not: https://builds.apache.org/job/beam_Dependency_Check/237/
> {noformat}
> 15:43:02 Start processing: - com.google.cloud.bigtable:bigtable-client-core [1.8.0 -> 1.12.1]
> 15:43:02
> 15:43:02 INFO:root:Finding release date of com.google.cloud.bigtable:bigtable-client-core 1.8.0 from the Maven Central
> 15:43:02 INFO:root:Finding release date of com.google.cloud.bigtable:bigtable-client-core 1.12.1 from the Maven Central
> 15:43:03 INFO:root:Start handling the JIRA issues for Java dependency: com.google.cloud.bigtable:bigtable-client-core 1.12.1
> 15:43:04 INFO:root:The parent issue BEAM-8690 is not opening. Attempt reopening the issue
> 15:43:04 Traceback (most recent call last):
> 15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/.test-infra/jenkins/jira_utils/jira_manager.py", line 90, in run
> 15:43:04 self.jira.reopen_issue(parent_issue)
> 15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/.test-infra/jenkins/jira_utils/jira_client.py", line 130, in reopen_issue
> 15:43:04 self.jira.transition_issue(issue.key, 3)
> 15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/dependency/check/lib/python3.5/site-packages/jira/client.py", line 126, in wrapper
> 15:43:04 result = func(*arg_list, **kwargs)
> 15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/dependency/check/lib/python3.5/site-packages/jira/client.py", line 1578, in transition_issue
> 15:43:04 url, data=json.dumps(data))
> 15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/dependency/check/lib/python3.5/site-packages/jira/resilientsession.py", line 154, in post
> 15:43:04 return self.__verb('POST', url, **kwargs)
> 15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/dependency/check/lib/python3.5/site-packages/jira/resilientsession.py", line 147, in __verb
> 15:43:04 raise_on_error(response, verb=verb, **kwargs)
> 15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/dependency/check/lib/python3.5/site-packages/jira/resilientsession.py", line 57, in raise_on_error
> 15:43:04 r.status_code, error, r.url, request=request, response=r, **kwargs)
> 15:43:04 jira.exceptions.JIRAError: JiraError HTTP 400 url: https://issues.apache.org/jira/rest/api/2/issue/BEAM-8690/transitions
> 15:43:04 text: It seems that you have tried to perform a workflow operation (Reopen Issue) that is not valid for the current state of this issue (BEAM-8690). The likely cause is that somebody has changed the issue recently, please look at the issue history for details.
> 15:43:04
> 15:43:04 response headers = {'X-AREQUESTID': '1243x60347388x3', 'Date': 'Mon, 18 Nov 2019 20:43:04 GMT', 'X-AUSERNAME': ****, 'Cache-Control': 'no-cache, no-store, no-transform', 'Server': 'Apache', 'Connection': 'close', 'X-XSS-Protection': '1; mode=block', 'Content-Type': 'application/json;charset=UTF-8', 'Content-Security-Policy': "frame-ancestors 'self'", 'Transfer-Encoding': 'chunked', 'X-Frame-Options': 'SAMEORIGIN', 'X-ASEN': 'SEN-2062203', 'X-Seraph-LoginReason': 'OK', 'X-Content-Type-Options': 'nosniff', 'X-ASESSIONID': '877oha'}
> 15:43:04 response text = {"errorMessages":["It seems that you have tried to perform a workflow operation (Reopen Issue) that is not valid for the current state of this issue (BEAM-8690). The likely cause is that somebody has changed the issue recently, please look at the issue history for details."],"errors":{}}
> 15:43:04 ERROR:root:Failed reopening the parent issue BEAM-8690.
> 15:43:04 Stop handling the JIRA issue for com.google.cloud.bigtable:bigtable-client-core, 1.12.1
> 15:43:04 Traceback (most recent call last):
> 15:43:04 File "/home/jenkins/jenkins-slave/workspace/beam_Dependency_Check/src/.test-infra/jenkins/dependency_check/dependency_check_report_generator.py", line 143, in prioritize_dependencies
> 15:43:04 if (jira_issue.fields.status.name == 'Open' or
> 15:43:04 AttributeError: 'NoneType' object has no attribute 'fields'
> 15:43:04 INFO:root:
> {noformat}
> It seems JIRA ticket lifecycle issue. The successful case (https://issues.apache.org/jira/browse/BEAM-5897 ) has status Open, while the failed case has "TRIAGE NEEDED"
--
This message was sent by Atlassian Jira
(v8.3.4#803005)