You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Michael Semb Wever (Jira)" <ji...@apache.org> on 2020/04/20 11:03:00 UTC
[jira] [Comment Edited] (CASSANDRA-15729) Jenkins Test Results
Report in plaintext for ASF ML
[ https://issues.apache.org/jira/browse/CASSANDRA-15729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087602#comment-17087602 ]
Michael Semb Wever edited comment on CASSANDRA-15729 at 4/20/20, 11:02 AM:
---------------------------------------------------------------------------
First CI run is [here|https://ci-cassandra.apache.org/job/Cassandra-devbranch-dtest/72/]. This tests the dtest-large [fix|https://github.com/apache/cassandra-dtest/pull/66] and pytest packaging [fix|https://github.com/apache/cassandra-builds/compare/master...thelastpickle:mck/jenkins-test-report-format].
was (Author: michaelsembwever):
First CI run is [here|https://ci-cassandra.apache.org/job/Cassandra-devbranch-dtest/72/]. This tests the dtest-large [fix|https://github.com/apache/cassandra-dtest/pull/66] and builds pytest packaging [fix|https://github.com/apache/cassandra-builds/compare/master...thelastpickle:mck/jenkins-test-report-format].
> Jenkins Test Results Report in plaintext for ASF ML
> ---------------------------------------------------
>
> Key: CASSANDRA-15729
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15729
> Project: Cassandra
> Issue Type: Task
> Components: Build, CI
> Reporter: Michael Semb Wever
> Assignee: Michael Semb Wever
> Priority: Normal
> Labels: Jenkins
> Fix For: 4.0-beta
>
>
> The Jenkins pipeline builds now aggregate all test reports.
> For example:
> - https://ci-cassandra.apache.org/job/Cassandra-trunk/68/testReport/
> - https://ci-cassandra.apache.org/blue/organizations/jenkins/Cassandra-trunk/detail/Cassandra-trunk/68/tests
> But Jenkins can only keep a limited amount of build history, so those links are not permanent, can't be used as references, and don't help for bisecting and blame on regressions (and flakey tests) over a longer period of time.
> The builds@ ML can provide a permanent record of test results.
> This was first brought up in these two threads:
> - https://lists.apache.org/thread.html/re8122e4fdd8629e7fbca2abf27d72054b3bc0e3690ece8b8e66f618b%40%3Cdev.cassandra.apache.org%3E
> - https://lists.apache.org/thread.html/ra5f6aeea89546825fe7ccc4a80898c62f8ed57decabf709d81d9c720%40%3Cdev.cassandra.apache.org%3E
> An example plaintext report, to demonstrate feasibility, is available here: https://lists.apache.org/thread.html/r80d13f7af706bf8dfbf2387fab46004c1fbd3917b7bc339c49e69aa8%40%3Cbuilds.cassandra.apache.org%3E
> Hurdles:
> - the ASF mailing lists won't except html, attachments, or any message body over 1MB.
> - packages are used as a differentiator in the final aggregated report. The cqlsh and dtests currently don't specify it. It needs to be added as a "dot-separated" prefix to the testsuite and testcase name.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org