You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/12/01 08:52:35 UTC

[GitHub] [airflow] aaronli94 opened a new issue #19926: The task has not started causing dag blocking

aaronli94 opened a new issue #19926:
URL: https://github.com/apache/airflow/issues/19926


   ### Apache Airflow version
   
   2.1.1
   
   ### Operating System
   
   Debian GNU/Linux 10 (buster)
   
   ### Versions of Apache Airflow Providers
   
   FROM apache/airflow:2.1.1-python3.8
   
   USER root
   
   
   RUN set -ex \
       && apt-get update -yqq \
       && apt-get install -yqq --no-install-recommends \
           openssh-server \
           openssh-client \
           libssl-dev \
           libffi-dev \
           cmake \
           git \
           gcc \
           musl-dev \
   		jq \
   		libpq-dev python-dev python3-pip \
   		sudo \
   	&& apt-get remove python-cffi \
   	&& echo "\"airflow\" ALL=(ALL) NOPASSWD:ALL" > /etc/sudoers.d/airflow \
   	&& curl -sL https://deb.nodesource.com/setup_12.x | bash - \
       && apt-get install -yqq --no-install-recommends  nodejs \
   	&& curl -sL https://aka.ms/InstallAzureCLIDeb | bash \
   	&& python -m pip install --upgrade pip
   
   RUN echo 'root:123456' | chpasswd \
       && echo 'airflow:123456' | chpasswd \
       && sed -i 's/#PermitRootLogin prohibit-password/PermitRootLogin yes/' /etc/ssh/sshd_config \
       && sed -i 's/#PubkeyAuthentication/PubkeyAuthentication/' /etc/ssh/sshd_config
   
   USER airflow
   ARG AIRFLOW_USER_HOME=/home/airflow
   ENV PATH=${AIRFLOW_USER_HOME}/.local/bin:${PATH}
   WORKDIR ${AIRFLOW_USER_HOME}
   
   RUN set -ex \
   	&& pip install snowflake-sqlalchemy==1.2.4 \
   	&& pip install snowflake-connector-python==2.4.6 \
       && pip install apache-airflow-providers-snowflake[slack]==2.1.1 \
   	&& pip install apache-airflow-providers-dingding[http]==2.0.1 \
   	&& pip install apache-airflow-providers-elasticsearch==2.0.1
   
   RUN set -ex \
   	&& pip install dbt==0.20.0
   
   RUN set -ex \
   	&& pip install azure.identity==1.6.0 \
   	&& pip install azure-keyvault-secrets==4.3.0 \
   	&& pip install kubernetes==11.0.0 \
       && pip install airflow-dbt==0.4.0 \
   	&& pip install great_expectations==0.13.32 \
   	&& pip install mysql-connector-python==8.0.21 \
       && pip install looker-sdk==0.1.3b20 \
       && pip install pytest==6.1.1 \
       && pip install Office365-REST-Python-Client==2.2.1
   
   RUN set -ex \
       && pip install h3==3.7.3
   
   RUN set -ex \
   	&& pip install PyMySQL==0.10.0 \
   	&& pip install pyarrow==3.0.0
   
   EXPOSE 8080 5555 8793
   
   ### Deployment
   
   Docker-Compose
   
   ### Deployment details
   
   _No response_
   
   ### What happened
   
   Access to airflow-web is very slow, some task has not started causing dag blocking, and there is no task currently being scheduled, system resources are sufficient
   
   ### What you expected to happen
   
   _No response_
   
   ### How to reproduce
   
   _No response_
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] potiuk closed issue #19926: The task has not started causing dag blocking

Posted by GitBox <gi...@apache.org>.
potiuk closed issue #19926:
URL: https://github.com/apache/airflow/issues/19926


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] boring-cyborg[bot] commented on issue #19926: The task has not started causing dag blocking

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #19926:
URL: https://github.com/apache/airflow/issues/19926#issuecomment-983421565


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org