[jira] [Created] (AIRFLOW-1638) Add missing dependancies to requires.txt

["Fokko Driesprong (JIRA)" <ji...@apache.org>]

Fokko Driesprong created AIRFLOW-1638:
-----------------------------------------

             Summary: Add missing dependancies to requires.txt
                 Key: AIRFLOW-1638
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1638
             Project: Apache Airflow
          Issue Type: Bug
            Reporter: Fokko Driesprong
            Assignee: Fokko Driesprong


Hi All,

There are some missing/outdated dependancies in ./apache_airflow.egg-info/requires.txt. For testing I use Docker to create a clean testing environment. When I install it from scratch, I get a dependancy error when installing the environment using `pip install -e .[devel]`:

```
root@1d11d49300ef:/airflow# airflow initdb
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 664, in _build_master
    ws.require(__requires__)
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 981, in require
    needed = self.resolve(parse_requirements(requirements))
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 872, in resolve
    raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.ContextualVersionConflict: (Flask-WTF 0.12 (/usr/local/lib/python3.6/site-packages), Requirement.parse('flask-wtf==0.14'), {'apache-airflow'})

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/airflow", line 4, in <module>
    __import__('pkg_resources').require('apache-airflow==1.10.0.dev0+incubating')
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 3074, in <module>
    @_call_aside
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 3058, in _call_aside
    f(*args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 3087, in _initialize_master_working_set
    working_set = WorkingSet._build_master()
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 666, in _build_master
    return cls._build_from_requirements(__requires__)
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 679, in _build_from_requirements
    dists = ws.resolve(reqs, Environment())
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 867, in resolve
    raise DistributionNotFound(req, requirers)
pkg_resources.DistributionNotFound: The 'flask-wtf==0.14' distribution was not found and is required by apache-airflow
```

This is due mismatch of dependancies in `airflow.egg-info/requires.txt`:
```
Fokkos-MacBook-Pro:incubator-airflow fokkodriesprong$ grep -i -R "flask-wtf" .
./airflow.egg-info/requires.txt:flask-wtf==0.12
./apache_airflow.egg-info/requires.txt:flask-wtf==0.14
```
Therefore I would like to upgrade the Flask-WTF from 0.12 to 0.14.

Same for the bleach dependancy which was missing:
```
root@2ffd781e2db3:/airflow# airflow initdb
Traceback (most recent call last):
  File "/usr/local/bin/airflow", line 4, in <module>
    __import__('pkg_resources').require('apache-airflow==1.10.0.dev0+incubating')
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 3074, in <module>
    @_call_aside
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 3058, in _call_aside
    f(*args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 3087, in _initialize_master_working_set
    working_set = WorkingSet._build_master()
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 664, in _build_master
    ws.require(__requires__)
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 981, in require
    needed = self.resolve(parse_requirements(requirements))
  File "/usr/local/lib/python3.6/site-packages/pkg_resources/__init__.py", line 867, in resolve
    raise DistributionNotFound(req, requirers)
pkg_resources.DistributionNotFound: The 'bleach==2.0.0' distribution was not found and is required by apache-airflow
```
I've added this requirement for the development environment.

Cheers, Fokko



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)