You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Mateusz Jeziorski (JIRA)" <ji...@apache.org> on 2019/05/28 16:16:00 UTC
[jira] [Created] (AIRFLOW-4583) ERROR - a bytes-like object is
required, not 'str' while using gcp_conn_id and python3
Mateusz Jeziorski created AIRFLOW-4583:
------------------------------------------
Summary: ERROR - a bytes-like object is required, not 'str' while using gcp_conn_id and python3
Key: AIRFLOW-4583
URL: https://issues.apache.org/jira/browse/AIRFLOW-4583
Project: Apache Airflow
Issue Type: Bug
Components: gcp
Affects Versions: 1.10.1
Reporter: Mateusz Jeziorski
I use airflow connection to store GCP service account key. While using the {{gcp_conn_id}} in {{GKEPodOperator}} and python3 I'm getting error at the method that tries to write key to temp file
{code}
[2019-05-28 13:41:02,348] {models.py:1760} ERROR - a bytes-like object is required, not 'str'
Traceback (most recent call last)
File "/usr/local/lib/airflow/airflow/models.py", line 1659, in _run_raw_tas
result = task_copy.execute(context=context
File "/usr/local/lib/airflow/airflow/contrib/operators/gcp_container_operator.py", line 254, in execut
key_file = self._set_env_from_extras(extras=extras
File "/usr/local/lib/airflow/airflow/contrib/operators/gcp_container_operator.py", line 303, in _set_env_from_extra
service_key.write(keyfile_json_str
File "/opt/python3.6/lib/python3.6/tempfile.py", line 485, in func_wrappe
return func(*args, **kwargs
TypeError: a bytes-like object is required, not 'str
[2019-05-28 13:41:02,361] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op [2019-05-28 13:41:02,348] {models.py:1760} ERROR - a bytes-like object is required, not 'str'
[2019-05-28 13:41:02,363] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op Traceback (most recent call last):
[2019-05-28 13:41:02,363] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/lib/airflow/airflow/models.py", line 1659, in _run_raw_task
[2019-05-28 13:41:02,363] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op result = task_copy.execute(context=context)
[2019-05-28 13:41:02,364] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/lib/airflow/airflow/contrib/operators/gcp_container_operator.py", line 254, in execute
[2019-05-28 13:41:02,364] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op key_file = self._set_env_from_extras(extras=extras)
[2019-05-28 13:41:02,364] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/lib/airflow/airflow/contrib/operators/gcp_container_operator.py", line 303, in _set_env_from_extras
[2019-05-28 13:41:02,365] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op service_key.write(keyfile_json_str)
[2019-05-28 13:41:02,365] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/opt/python3.6/lib/python3.6/tempfile.py", line 485, in func_wrapper
[2019-05-28 13:41:02,365] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op return func(*args, **kwargs)
[2019-05-28 13:41:02,366] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op TypeError: a bytes-like object is required, not 'str'
[2019-05-28 13:41:02,367] {models.py:1791} INFO - Marking task as FAILED.
[2019-05-28 13:41:02,368] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op [2019-05-28 13:41:02,367] {models.py:1791} INFO - Marking task as FAILED.
[2019-05-28 13:41:02,416] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op Traceback (most recent call last):
[2019-05-28 13:41:02,417] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/bin/airflow", line 7, in <module>
[2019-05-28 13:41:02,418] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op exec(compile(f.read(), __file__, 'exec'))
[2019-05-28 13:41:02,418] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/lib/airflow/airflow/bin/airflow", line 32, in <module>
[2019-05-28 13:41:02,419] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op args.func(args)
[2019-05-28 13:41:02,420] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/lib/airflow/airflow/utils/cli.py", line 74, in wrapper
[2019-05-28 13:41:02,421] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op return f(*args, **kwargs)
[2019-05-28 13:41:02,421] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/lib/airflow/airflow/bin/cli.py", line 490, in run
[2019-05-28 13:41:02,422] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op _run(args, dag, ti)
[2019-05-28 13:41:02,423] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/lib/airflow/airflow/bin/cli.py", line 406, in _run
[2019-05-28 13:41:02,423] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op pool=args.pool,
[2019-05-28 13:41:02,423] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/lib/airflow/airflow/utils/db.py", line 74, in wrapper
[2019-05-28 13:41:02,425] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op return func(*args, **kwargs)
[2019-05-28 13:41:02,425] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/lib/airflow/airflow/models.py", line 1659, in _run_raw_task
[2019-05-28 13:41:02,426] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op result = task_copy.execute(context=context)
[2019-05-28 13:41:02,426] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/lib/airflow/airflow/contrib/operators/gcp_container_operator.py", line 254, in execute
[2019-05-28 13:41:02,427] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op key_file = self._set_env_from_extras(extras=extras)
[2019-05-28 13:41:02,428] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/usr/local/lib/airflow/airflow/contrib/operators/gcp_container_operator.py", line 303, in _set_env_from_extras
[2019-05-28 13:41:02,428] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op service_key.write(keyfile_json_str)
[2019-05-28 13:41:02,428] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op File "/opt/python3.6/lib/python3.6/tempfile.py", line 485, in func_wrapper
[2019-05-28 13:41:02,430] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op return func(*args, **kwargs)
[2019-05-28 13:41:02,430] {base_task_runner.py:101} INFO - Job 2068: Subtask pod_op TypeError: a bytes-like object is required, not 'str'
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)