You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by Venkat Swaminathan <ge...@gmail.com> on 2021/05/04 03:55:20 UTC
Docker compose file for Airflow v1
Hi all,
I'm trying to create a docker-compose file for version-1 (either 1.10.14 or
1.10.15), which is closely similar to the stable version (2.0.1 or above).
I copy-pasted the docker-compose file for v2.
Then did "docker-compose up airflow-init" as described in the docs. However
I got some errors starting with,
"[2021-05-04 03:48:17,927] {__init__.py:71} CRITICAL - Cannot import
airflow.api.auth.backend.basic_auth for API authentication due to: No
module named 'airflow.api.auth.backend.basic_auth'"
I then removed the line,
AIRFLOW__API__AUTH_BACKEND: 'airflow.api.auth.backend.basic_auth'
Now it passed the airflow-init, but fails further on "docker-compose up"
I think the relevant error is,
postgres_1 | 2021-05-04 03:04:12.397 UTC [129] ERROR: relation
"log" does not exist at character 13
Somehow the postgres db doesn't start normally.
All these commands were successful for v2 though. Any help would be
appreciated.
I have to say, I'm a newbie to Airflow though.
Regards,
Venkat.
Re: Docker compose file for Airflow v1
Posted by Jarek Potiuk <ja...@potiuk.com>.
There were only 1.10-15-python* tags indeed. I fixed it now - 1.10.15 now
points to 1.10.15-pyhon3.6 as it should.
On Tue, May 4, 2021 at 7:20 PM Venkat Swaminathan <ge...@gmail.com>
wrote:
> Thank you. I saw that issue and the specific comment. However for version
> 1.10.14 with postgres and redis, the docker-compose file has this line
>
> image: apache/airflow:2.0.0
>
> This fails during startup.
>
> Now retrying that I changed the version to 1.10.14 and changing to
> postgres-13 seems to start the ui with no errors. Thanks again for the
> pointer.
>
> BTW, there seems to be no docker image with 1.10.15 tag. Not sure if this
> is intentional or not.
>
>
>
> On Tue, May 4, 2021 at 4:11 AM .... <dz...@gmail.com> wrote:
>
>> For working docker compose files for Airflow 1.10, see:
>> https://github.com/apache/airflow/issues/8605#issuecomment-759469443
>>
>> On Tue, May 4, 2021, 06:00 Venkat Swaminathan <ge...@gmail.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> I'm trying to create a docker-compose file for version-1 (either 1.10.14
>>> or 1.10.15), which is closely similar to the stable version (2.0.1 or
>>> above).
>>>
>>> I copy-pasted the docker-compose file for v2.
>>>
>>> Then did "docker-compose up airflow-init" as described in the docs.
>>> However I got some errors starting with,
>>>
>>> "[2021-05-04 03:48:17,927] {__init__.py:71} CRITICAL - Cannot import
>>> airflow.api.auth.backend.basic_auth for API authentication due to: No
>>> module named 'airflow.api.auth.backend.basic_auth'"
>>>
>>> I then removed the line,
>>>
>>> AIRFLOW__API__AUTH_BACKEND: 'airflow.api.auth.backend.basic_auth'
>>>
>>> Now it passed the airflow-init, but fails further on "docker-compose up"
>>>
>>> I think the relevant error is,
>>> postgres_1 | 2021-05-04 03:04:12.397 UTC [129] ERROR:
>>> relation "log" does not exist at character 13
>>>
>>> Somehow the postgres db doesn't start normally.
>>>
>>> All these commands were successful for v2 though. Any help would be
>>> appreciated.
>>> I have to say, I'm a newbie to Airflow though.
>>>
>>> Regards,
>>> Venkat.
>>>
>>>
>>>
>>>
>>>
--
+48 660 796 129
Re: Docker compose file for Airflow v1
Posted by Venkat Swaminathan <ge...@gmail.com>.
Thank you. I saw that issue and the specific comment. However for version
1.10.14 with postgres and redis, the docker-compose file has this line
image: apache/airflow:2.0.0
This fails during startup.
Now retrying that I changed the version to 1.10.14 and changing to
postgres-13 seems to start the ui with no errors. Thanks again for the
pointer.
BTW, there seems to be no docker image with 1.10.15 tag. Not sure if this
is intentional or not.
On Tue, May 4, 2021 at 4:11 AM .... <dz...@gmail.com> wrote:
> For working docker compose files for Airflow 1.10, see:
> https://github.com/apache/airflow/issues/8605#issuecomment-759469443
>
> On Tue, May 4, 2021, 06:00 Venkat Swaminathan <ge...@gmail.com> wrote:
>
>> Hi all,
>>
>> I'm trying to create a docker-compose file for version-1 (either 1.10.14
>> or 1.10.15), which is closely similar to the stable version (2.0.1 or
>> above).
>>
>> I copy-pasted the docker-compose file for v2.
>>
>> Then did "docker-compose up airflow-init" as described in the docs.
>> However I got some errors starting with,
>>
>> "[2021-05-04 03:48:17,927] {__init__.py:71} CRITICAL - Cannot import
>> airflow.api.auth.backend.basic_auth for API authentication due to: No
>> module named 'airflow.api.auth.backend.basic_auth'"
>>
>> I then removed the line,
>>
>> AIRFLOW__API__AUTH_BACKEND: 'airflow.api.auth.backend.basic_auth'
>>
>> Now it passed the airflow-init, but fails further on "docker-compose up"
>>
>> I think the relevant error is,
>> postgres_1 | 2021-05-04 03:04:12.397 UTC [129] ERROR: relation
>> "log" does not exist at character 13
>>
>> Somehow the postgres db doesn't start normally.
>>
>> All these commands were successful for v2 though. Any help would be
>> appreciated.
>> I have to say, I'm a newbie to Airflow though.
>>
>> Regards,
>> Venkat.
>>
>>
>>
>>
>>
Re: Docker compose file for Airflow v1
Posted by "...." <dz...@gmail.com>.
For working docker compose files for Airflow 1.10, see:
https://github.com/apache/airflow/issues/8605#issuecomment-759469443
On Tue, May 4, 2021, 06:00 Venkat Swaminathan <ge...@gmail.com> wrote:
> Hi all,
>
> I'm trying to create a docker-compose file for version-1 (either 1.10.14
> or 1.10.15), which is closely similar to the stable version (2.0.1 or
> above).
>
> I copy-pasted the docker-compose file for v2.
>
> Then did "docker-compose up airflow-init" as described in the docs.
> However I got some errors starting with,
>
> "[2021-05-04 03:48:17,927] {__init__.py:71} CRITICAL - Cannot import
> airflow.api.auth.backend.basic_auth for API authentication due to: No
> module named 'airflow.api.auth.backend.basic_auth'"
>
> I then removed the line,
>
> AIRFLOW__API__AUTH_BACKEND: 'airflow.api.auth.backend.basic_auth'
>
> Now it passed the airflow-init, but fails further on "docker-compose up"
>
> I think the relevant error is,
> postgres_1 | 2021-05-04 03:04:12.397 UTC [129] ERROR: relation
> "log" does not exist at character 13
>
> Somehow the postgres db doesn't start normally.
>
> All these commands were successful for v2 though. Any help would be
> appreciated.
> I have to say, I'm a newbie to Airflow though.
>
> Regards,
> Venkat.
>
>
>
>
>