You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Hariharan Mohanraj (JIRA)" <ji...@apache.org> on 2016/05/26 23:59:13 UTC
[jira] [Updated] (AIRFLOW-182) CLI command `airflow backfill` fails
while CLI `airflow run` succeeds
[ https://issues.apache.org/jira/browse/AIRFLOW-182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hariharan Mohanraj updated AIRFLOW-182:
---------------------------------------
Priority: Minor (was: Major)
> CLI command `airflow backfill` fails while CLI `airflow run` succeeds
> ---------------------------------------------------------------------
>
> Key: AIRFLOW-182
> URL: https://issues.apache.org/jira/browse/AIRFLOW-182
> Project: Apache Airflow
> Issue Type: Bug
> Components: celery
> Affects Versions: Airflow 1.7.0
> Environment: Heroku Cedar 14, Heroku Redis as Celery Broker
> Reporter: Hariharan Mohanraj
> Priority: Minor
>
> When I run the backfill command, I get an error that claims there is no dag in my dag folder with the name "unusual_prefix_dag1", although my dag is actually named dag1. However when I run the run command, the task is scheduled and it works flawlessly.
> {code}
> $ airflow backfill -t task1 -s 2016-05-01 -e 2016-05-07 dag1
> 2016-05-26T23:22:28.816908+00:00 app[worker.1]: [2016-05-26 23:22:28,816] {__init__.py:36} INFO - Using executor CeleryExecutor
> 2016-05-26T23:22:29.214006+00:00 app[worker.1]: Traceback (most recent call last):
> 2016-05-26T23:22:29.214083+00:00 app[worker.1]: File "/app/.heroku/python/bin/airflow", line 15, in <module>
> 2016-05-26T23:22:29.214121+00:00 app[worker.1]: args.func(args)
> 2016-05-26T23:22:29.214151+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/airflow/bin/cli.py", line 174, in run
> 2016-05-26T23:22:29.214207+00:00 app[worker.1]: DagPickle).filter(DagPickle.id == args.pickle).first()
> 2016-05-26T23:22:29.214230+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2634, in first
> 2016-05-26T23:22:29.214616+00:00 app[worker.1]: ret = list(self[0:1])
> 2016-05-26T23:22:29.214626+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line 2457, in __getitem__
> 2016-05-26T23:22:29.214984+00:00 app[worker.1]: return list(res)
> 2016-05-26T23:22:29.214992+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/sqlalchemy/orm/loading.py", line 86, in instances
> 2016-05-26T23:22:29.215053+00:00 app[worker.1]: util.raise_from_cause(err)
> 2016-05-26T23:22:29.215074+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
> 2016-05-26T23:22:29.215121+00:00 app[worker.1]: reraise(type(exception), exception, tb=exc_tb, cause=cause)
> 2016-05-26T23:22:29.215142+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/sqlalchemy/orm/loading.py", line 71, in instances
> 2016-05-26T23:22:29.215175+00:00 app[worker.1]: rows = [proc(row) for row in fetch]
> 2016-05-26T23:22:29.215200+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/sqlalchemy/orm/loading.py", line 428, in _instance
> 2016-05-26T23:22:29.215274+00:00 app[worker.1]: loaded_instance, populate_existing, populators)
> 2016-05-26T23:22:29.215282+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/sqlalchemy/orm/loading.py", line 486, in _populate_full
> 2016-05-26T23:22:29.215369+00:00 app[worker.1]: dict_[key] = getter(row)
> 2016-05-26T23:22:29.215406+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/sqlalchemy/sql/sqltypes.py", line 1253, in process
> 2016-05-26T23:22:29.215574+00:00 app[worker.1]: return loads(value)
> 2016-05-26T23:22:29.215595+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/dill/dill.py", line 260, in loads
> 2016-05-26T23:22:29.215657+00:00 app[worker.1]: return load(file)
> 2016-05-26T23:22:29.215678+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/dill/dill.py", line 250, in load
> 2016-05-26T23:22:29.215738+00:00 app[worker.1]: obj = pik.load()
> 2016-05-26T23:22:29.215758+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/pickle.py", line 858, in load
> 2016-05-26T23:22:29.215895+00:00 app[worker.1]: dispatch[key](self)
> 2016-05-26T23:22:29.215902+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/pickle.py", line 1090, in load_global
> 2016-05-26T23:22:29.216069+00:00 app[worker.1]: klass = self.find_class(module, name)
> 2016-05-26T23:22:29.216077+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/site-packages/dill/dill.py", line 406, in find_class
> 2016-05-26T23:22:29.216181+00:00 app[worker.1]: return StockUnpickler.find_class(self, module, name)
> 2016-05-26T23:22:29.216190+00:00 app[worker.1]: File "/app/.heroku/python/lib/python2.7/pickle.py", line 1124, in find_class
> 2016-05-26T23:22:29.216360+00:00 app[worker.1]: __import__(module)
> 2016-05-26T23:22:29.216412+00:00 app[worker.1]: ImportError: No module named unusual_prefix_dag1
> # runs flawlessly
> $ airflow run dag1 task1 2016-05-07
> {code}
> Apologies if the format is wrong or if I haven't provided enough information, this is the first time I've ever submitted an issue .. anywhere!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)