You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/07/09 05:45:38 UTC
[GitHub] [airflow] baaj2109 commented on issue #16903: TypeError: cannot serialize '_io.TextIOWrapper' object
baaj2109 commented on issue #16903:
URL: https://github.com/apache/airflow/issues/16903#issuecomment-876930539
I update airflow from 2.1.0 to 2.1.1, got new error message
```
/usr/lib/python3/dist-packages/requests/__init__.py:80 RequestsDependencyWarning: urllib3 (1.26.6) or chardet (3.0.4) doesn't match a supported version!
/home/baaj2109/.local/lib/python3.6/site-packages/airflow/cli/commands/dag_command.py:62 PendingDeprecationWarning: --ignore-first-depends-on-past is deprecated as the value is always set to True
[2021-07-09 13:40:54,845] {dagbag.py:496} INFO - Filling up the DagBag from /home/baaj2109/airflow/dags
[2021-07-09 13:40:59,404] {default_celery.py:100} WARNING - You have configured a result_backend of amqp://guest:guest@localhost:5672//, it is highly recommended to use an alternative result_backend (i.e. a database).
[2021-07-09 13:41:00,062] {backfill_job.py:903} INFO - Reset the following 3 TaskInstances:
<TaskInstance: tutorial.print_date 2019-10-01 00:00:00+00:00 [None]>
<TaskInstance: tutorial.templated 2019-10-01 00:00:00+00:00 [None]>
<TaskInstance: tutorial.sleep 2019-10-01 00:00:00+00:00 [None]>
[2021-07-09 13:41:00,206] {backfill_job.py:903} INFO - Reset the following 3 TaskInstances:
<TaskInstance: tutorial.print_date 2019-10-02 00:00:00+00:00 [None]>
<TaskInstance: tutorial.templated 2019-10-02 00:00:00+00:00 [None]>
<TaskInstance: tutorial.sleep 2019-10-02 00:00:00+00:00 [None]>
[2021-07-09 13:41:00,449] {backfill_job.py:903} INFO - Reset the following 3 TaskInstances:
<TaskInstance: tutorial.print_date 2019-10-03 00:00:00+00:00 [None]>
<TaskInstance: tutorial.templated 2019-10-03 00:00:00+00:00 [None]>
<TaskInstance: tutorial.sleep 2019-10-03 00:00:00+00:00 [None]>
[2021-07-09 13:41:00,584] {backfill_job.py:903} INFO - Reset the following 3 TaskInstances:
<TaskInstance: tutorial.print_date 2019-10-04 00:00:00+00:00 [None]>
<TaskInstance: tutorial.templated 2019-10-04 00:00:00+00:00 [None]>
<TaskInstance: tutorial.sleep 2019-10-04 00:00:00+00:00 [None]>
[2021-07-09 13:41:00,838] {backfill_job.py:903} INFO - Reset the following 3 TaskInstances:
<TaskInstance: tutorial.print_date 2019-10-05 00:00:00+00:00 [None]>
<TaskInstance: tutorial.templated 2019-10-05 00:00:00+00:00 [None]>
<TaskInstance: tutorial.sleep 2019-10-05 00:00:00+00:00 [None]>
[2021-07-09 13:41:00,998] {base_executor.py:82} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'tutorial', 'print_date', '2019-10-01T00:00:00+00:00', '--ignore-depends-on-past', '--local', '--pool', 'default_pool', '--subdir', 'DAGS_FOLDER/test.py']
[2021-07-09 13:41:01,083] {base_executor.py:82} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'tutorial', 'print_date', '2019-10-02T00:00:00+00:00', '--local', '--pool', 'default_pool', '--subdir', 'DAGS_FOLDER/test.py']
[2021-07-09 13:41:01,184] {base_executor.py:82} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'tutorial', 'print_date', '2019-10-03T00:00:00+00:00', '--local', '--pool', 'default_pool', '--subdir', 'DAGS_FOLDER/test.py']
[2021-07-09 13:41:01,340] {base_executor.py:82} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'tutorial', 'print_date', '2019-10-04T00:00:00+00:00', '--local', '--pool', 'default_pool', '--subdir', 'DAGS_FOLDER/test.py']
[2021-07-09 13:41:01,395] {base_executor.py:82} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'tutorial', 'print_date', '2019-10-05T00:00:00+00:00', '--local', '--pool', 'default_pool', '--subdir', 'DAGS_FOLDER/test.py']
Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/queues.py", line 234, in _feed
obj = _ForkingPickler.dumps(obj)
File "/usr/lib/python3.6/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot serialize '_io.TextIOWrapper' object
Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/queues.py", line 234, in _feed
obj = _ForkingPickler.dumps(obj)
File "/usr/lib/python3.6/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot serialize '_io.TextIOWrapper' object
Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/queues.py", line 234, in _feed
obj = _ForkingPickler.dumps(obj)
File "/usr/lib/python3.6/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot serialize '_io.TextIOWrapper' object
```
and after I type ctrl+c, show another message
```
^CProcess Process-1:
Process Process-3:
Process Process-2:
Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python3.6/multiprocessing/process.py", line 93, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/python3.6/concurrent/futures/process.py", line 169, in _process_worker
call_item = call_queue.get(block=True)
File "/usr/lib/python3.6/multiprocessing/queues.py", line 94, in get
res = self._recv_bytes()
File "/usr/lib/python3.6/multiprocessing/connection.py", line 216, in recv_bytes
buf = self._recv_bytes(maxlength)
File "/usr/lib/python3.6/multiprocessing/connection.py", line 407, in _recv_bytes
buf = self._recv(4)
File "/usr/lib/python3.6/multiprocessing/connection.py", line 379, in _recv
chunk = read(handle, remaining)
KeyboardInterrupt
Exception in thread Thread-1:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/python3.6/concurrent/futures/process.py", line 295, in _queue_management_worker
shutdown_worker()
File "/usr/lib/python3.6/concurrent/futures/process.py", line 253, in shutdown_worker
call_queue.put_nowait(None)
File "/usr/lib/python3.6/multiprocessing/queues.py", line 129, in put_nowait
return self.put(obj, False)
File "/usr/lib/python3.6/multiprocessing/queues.py", line 83, in put
raise Full
queue.Full
[2021-07-09 13:44:05,129] {backfill_job.py:822} WARNING - Backfill terminated by user.
[2021-07-09 13:44:05,559] {backfill_job.py:831} INFO - Backfill done. Exiting.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org