[jira] [Comment Edited] (BIGTOP-3214) Install python libraries for Livy

["Evans Ye (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16837983#comment-16837983 ] 

Evans Ye edited comment on BIGTOP-3214 at 5/12/19 3:19 AM:
-----------------------------------------------------------

No if you dig into the log, you can see they're failed because of git setting things. I'm taking your PR as a chance to setup some auto testing CI jobs.

If you want to do the test at local development phase, see the doc:
* https://cwiki.apache.org/confluence/display/BIGTOP/How+to+build+Bigtop-trunk
* https://cwiki.apache.org/confluence/display/BIGTOP/Quickstart+Guide%3A+Bigtop+Integration+Test+Framework+2.0

Basically the full life cycle of a test in Bigtop:
Build Docker slave images --> Packaging --> Deployment --> Smoke Tests 

The following two CI jobs do the works for a PR:
* Build Docker slave images: https://ci.bigtop.apache.org/view/Docker/job/Docker-Toolchain-Pull-Request
* Packaging --> Deployment --> Smoke Tests: https://ci.bigtop.apache.org/view/Packages/job/Manual-build-deploy-smoke-test

All in all, give me some time and I'll try to get more tests done. If you have some spare cycle, would you please help to develop a smoke test for livy so that we can have a basic visibility it?
* https://cwiki.apache.org/confluence/display/BIGTOP/Running+integration%2C+system%2C+and+package+tests


was (Author: evans_ye):
No if you dig into the log, you can see they're failed because of git setting things. I'm taking your PR as a chance to setup some auto testing CI jobs.

If you want to do the test at local development phase, see the doc:
* https://cwiki.apache.org/confluence/display/BIGTOP/How+to+build+Bigtop-trunk
* https://cwiki.apache.org/confluence/display/BIGTOP/Quickstart+Guide%3A+Bigtop+Integration+Test+Framework+2.0

Basically the full life cycle of a test in Bigtop:
Build Docker slave images --> Packaging --> Deployment --> Smoke Tests 

The following two CI jobs do the works for a PR:
* Build Docker slave images: https://ci.bigtop.apache.org/view/Docker/job/Docker-Toolchain-Pull-Request
* Packaging --> Deployment --> Smoke Tests: https://ci.bigtop.apache.org/view/Packages/job/Manual-build-deploy-smoke-test

All in all, give me some time and I'll try to get more tests done. If you have some spare cycle, would you please help to develop a smoke test for livy so that we can have a basic visibility it?

> Install python libraries for Livy
> ---------------------------------
>
>                 Key: BIGTOP-3214
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-3214
>             Project: Bigtop
>          Issue Type: Improvement
>          Components: toolchain
>            Reporter: Aki Tanaka
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> To add Livy package, we need to install some additinal Python packages. (https://github.com/apache/bigtop/pull/527/)
> * setuptools .. Need to install newer setuptools. setuptools is installed in the some of distributions, but the package version is old. We'll need to upgrade the package.
> * flake8 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)