You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@bigtop.apache.org by "Adam Kawa (JIRA)" <ji...@apache.org> on 2014/03/27 19:56:14 UTC

[jira] [Created] (BIGTOP-1262) Smoke tests for Luigi

Adam Kawa created BIGTOP-1262:
---------------------------------

             Summary: Smoke tests for Luigi
                 Key: BIGTOP-1262
                 URL: https://issues.apache.org/jira/browse/BIGTOP-1262
             Project: Bigtop
          Issue Type: New Feature
            Reporter: Adam Kawa
            Priority: Minor


_Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in._ Luigi is an alternative to Oozie and Azkaban. It is open-sourced [here|https://github.com/spotify/luigi].

At Spotify, we run thousands of jobs through Luigi each day. Foursquare, Bit.ly and more use and contribute to it.

We already have simple smoke tests that tests whether Luigi can

# run workflow locally
# run workflow on the Hadoop cluster

and would be happy to contribute them, if there is an interest and possibility (Luigi is not Apache project ... yet). 



--
This message was sent by Atlassian JIRA
(v6.2#6252)