[jira] [Created] (NIFI-4674) Evaluate moving longest running tests to integration-tests if appropriate

["Joseph Witt (JIRA)" <ji...@apache.org>]

Joseph Witt created NIFI-4674:
---------------------------------

             Summary: Evaluate moving longest running tests to integration-tests if appropriate
                 Key: NIFI-4674
                 URL: https://issues.apache.org/jira/browse/NIFI-4674
             Project: Apache NiFi
          Issue Type: Bug
          Components: Tools and Build
            Reporter: Joseph Witt
            Assignee: Joseph Witt


In an effort to get travis-ci builds to be more reliable and to reduce the overall build time in general it is important we strike a good balance between repetitive test runs focused on identifying quality changes quickly but that also the build time/cycle/environment works quickly as well.

There are a number of tests which take a long time to run by their nature and which are likely far more appropriate as integration-tests rather than unit tests.  The integration-tests are run in an opt-in manner whereas unit tests are always run (generally).

Here is a report of the longest running tests 
{noformat}
Tests run: 34, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 19.692 sec - in org.apache.nifi.toolkit.zkmigrator.ZooKeeperMigratorTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 13.797 sec - in org.wali.TestMinimalLockingWriteAheadLog
Tests run: 14, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 10.34 sec - in org.apache.nifi.security.util.scrypt.ScryptGroovyTest
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.608 sec - in org.apache.nifi.security.util.CertificateUtilsTest
Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.229 sec - in org.apache.nifi.remote.client.http.TestHttpClient
Tests run: 36, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.655 sec - in org.apache.nifi.ldap.tenants.LdapUserGroupProviderTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.557 sec - in org.apache.nifi.toolkit.tls.service.server.TlsCertificateAuthorityServiceHandlerTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.272 sec - in org.apache.nifi.toolkit.tls.service.TlsCertificateAuthorityTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.007 sec - in org.apache.nifi.toolkit.tls.service.client.TlsCertificateSigningRequestPerformerTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.785 sec - in org.apache.nifi.toolkit.tls.standalone.TlsToolkitStandaloneTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.199 sec - in org.apache.nifi.toolkit.tls.util.TlsHelperTest
Tests run: 35, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 104.692 sec - in org.apache.nifi.provenance.TestPersistentProvenanceRepository
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.141 sec - in org.apache.nifi.processors.TestGeoEnrichIP
Tests run: 4, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 10.675 sec - in org.apache.nifi.processors.flume.ExecuteFlumeSinkTest
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.234 sec - in org.apache.nifi.processors.evtx.ParseEvtxTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.291 sec - in org.apache.nifi.processors.script.TestExecuteJython
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.222 sec - in org.apache.nifi.processors.ignite.cache.TestGetIgniteCache
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.291 sec - in org.apache.nifi.processors.script.TestInvokeJython
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.91 sec - in org.apache.nifi.ranger.authorization.ManagedRangerAuthorizerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.871 sec - in org.apache.nifi.processors.script.TestExecuteJRuby
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.039 sec - in org.apache.nifi.web.standard.api.transformjson.TestTransformJSONResource
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.847 sec - in org.apache.nifi.processors.ccda.TestExtractCCDAAttributes
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.093 sec - in org.apache.nifi.processors.groovyx.ExecuteGroovyScriptTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.609 sec - in org.apache.nifi.processors.hive.TestPutHiveQL
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.615 sec - in org.apache.nifi.processors.hive.TestSelectHiveQL
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 37.16 sec - in org.apache.nifi.processors.poi.ConvertExcelToCSVProcessorTest
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.781 sec - in org.apache.nifi.processors.solr.TestPutSolrContentStream
Tests run: 49, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.896 sec - in org.apache.nifi.processors.standard.TestInvokeHTTP
Tests run: 12, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 10.533 sec - in org.apache.nifi.processors.standard.TestPutTcpSSL
Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 36.079 sec - in org.apache.nifi.processors.standard.TestInvokeHttpSSL
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.98 sec - in org.apache.nifi.controller.service.TestStandardControllerServiceProvider
Tests run: 32, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 11.249 sec - in org.apache.nifi.controller.repository.TestFileSystemRepository
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.692 sec - in org.apache.nifi.controller.repository.TestVolatileContentRepository
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.316 sec - in org.apache.nifi.processors.standard.TestListFile
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.123 sec - in org.apache.nifi.controller.TestFlowController
Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.306 sec - in org.apache.nifi.processors.standard.TestTailFile
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.87 sec - in org.apache.nifi.controller.state.providers.zookeeper.TestZooKeeperStateProvider
Tests run: 16, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 17.814 sec - in org.apache.nifi.controller.scheduling.TestProcessorLifecycle
Tests run: 9, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 16.12 sec - in org.apache.nifi.controller.scheduling.TestStandardProcessScheduler
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.502 sec - in org.apache.nifi.processors.standard.util.TestJdbcHugeStream
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.565 sec - in org.apache.nifi.web.security.x509.X509AuthenticationProviderTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 13.17 sec - in org.apache.nifi.web.security.x509.ocsp.OcspCertificateValidatorGroovyTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 5, Time elapsed: 2.69 sec - in org.apache.nifi.web.security.x509.ocsp.OcspCertificateValidatorTest
Tests run: 88, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 22.175 sec - in org.apache.nifi.properties.ConfigEncryptionToolTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.918 sec - in org.apache.nifi.toolkit.admin.client.NiFiClientFactorySpec
Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.325 sec - in org.apache.nifi.remote.client.http.TestHttpClient
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.837 sec - in org.apache.nifi.controller.service.TestStandardControllerServiceProvider
Tests run: 32, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 11.002 sec - in org.apache.nifi.controller.repository.TestFileSystemRepository
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.084 sec - in org.apache.nifi.controller.repository.TestVolatileContentRepository
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.763 sec - in org.apache.nifi.controller.TestFlowController
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.818 sec - in org.apache.nifi.controller.state.providers.zookeeper.TestZooKeeperStateProvider
Tests run: 16, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 17.177 sec - in org.apache.nifi.controller.scheduling.TestProcessorLifecycle
Tests run: 9, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 15.896 sec - in org.apache.nifi.controller.scheduling.TestStandardProcessScheduler
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.869 sec - in org.apache.nifi.web.security.x509.X509AuthenticationProviderTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 3, Time elapsed: 4.861 sec - in org.apache.nifi.web.security.x509.ocsp.OcspCertificateValidatorGroovyTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 5, Time elapsed: 4.176 sec - in org.apache.nifi.web.security.x509.ocsp.OcspCertificateValidatorTest
Tests run: 35, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 98.48 sec - in org.apache.nifi.provenance.TestPersistentProvenanceRepository
Tests run: 49, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.781 sec - in org.apache.nifi.processors.standard.TestInvokeHTTP
Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.304 sec - in org.apache.nifi.processors.standard.TestInvokeHttpSSL
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.201 sec - in org.apache.nifi.processors.standard.TestListFile
Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.238 sec - in org.apache.nifi.processors.standard.TestTailFile
Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.529 sec - in org.apache.nifi.toolkit.tls.standalone.TlsToolkitStandaloneTest
Tests run: 88, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 10.878 sec - in org.apache.nifi.properties.ConfigEncryptionToolTest
Tests run: 34, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 12.159 sec - in org.apache.nifi.toolkit.zkmigrator.ZooKeeperMigratorTest
{noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)