[jira] [Commented] (CALCITE-3141) Slow tests are not run in continuous integration

["Stamatis Zampetakis (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CALCITE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903835#comment-16903835 ] 

Stamatis Zampetakis commented on CALCITE-3141:
----------------------------------------------

Currently there are two ways of marking and running slow tests:
 * using a JUnit category and the org.apache.calcite.test.SlowTests annotation;
 * using the CalciteSystemProperty#TEST_SLOW property.

As shown above the CI uses the first approach so a big number of slow tests are not executed. I propose to unify the two ways in favor of the JUnit category so that all slow tests are run in CI and for not having to maintain both options.
 

> Slow tests are not run in continuous integration
> ------------------------------------------------
>
>                 Key: CALCITE-3141
>                 URL: https://issues.apache.org/jira/browse/CALCITE-3141
>             Project: Calcite
>          Issue Type: Bug
>    Affects Versions: 1.19.0, 1.20.0
>            Reporter: Stamatis Zampetakis
>            Assignee: Stamatis Zampetakis
>            Priority: Major
>             Fix For: 1.21.0
>
>
> Trying to execute slow tests locally always ends up with failures and these failures are not reflected in continuous integration (Jenkins, AppVeyor, Travis).
>  
> From the CI configuration below (extract from the logs) this appears normal for Jenkins and AppVeyor but not for Travis.
>  
> *Jenkins:*
> /home/jenkins/tools/maven/apache-maven-3.3.3/bin/mvn -f ws/pom.xml "-Dmaven.repo.local=/home/jenkins/jenkins-slave/workspace/Calcite-Master/jdk/JDK 1.8 (latest)/label_exp/ubuntu&&!cloud-slave&&!H27/.repository" clean install javadoc:javadoc -DskipITs -B
>  
> *Travis:*
> $ if [ $SLOW_TESTS = "Y" ]; then export TESTS="-Dgroups=org.apache.calcite.test.SlowTests --projects :calcite-core"; else export TESTS=-DskipSlowTests; fi
> The command "if [ $SLOW_TESTS = "Y" ]; then export TESTS="-Dgroups=org.apache.calcite.test.SlowTests --projects :calcite-core"; else export TESTS=-DskipSlowTests; fi" exited with 0.
>  
> *AppVeyor:*
> mvn -Dcheckstyle.skip -Dsurefire.useFile=false -Dsurefire.threadCount=1 -Dsurefire.perCoreThreadCount=false -Djavax.net.ssl.trustStorePassword=changeit test -Djna.nosys=true



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)