You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2018/03/05 23:14:00 UTC

[jira] [Created] (ARROW-2266) [CI] Improve runtime of integration tests in Travis CI

Wes McKinney created ARROW-2266:
-----------------------------------

             Summary: [CI] Improve runtime of integration tests in Travis CI
                 Key: ARROW-2266
                 URL: https://issues.apache.org/jira/browse/ARROW-2266
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Integration
            Reporter: Wes McKinney


I was surprised to see that travis_script_integration.sh is taking over 25 minutes to run. My only real guess about what's going on is that JVM startup time on these hosts is super slow.

I can think of some things we could do to make things better:

* Add debugging output so we can see what's slow
* Write a Java integration test handler that validates multiple files at once
* Generate a single set of binary files for each producer rather than regenerating them each time (so Java would only need to produce binary files once instead of 3 times like now)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)