You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "clementchane (via GitHub)" <gi...@apache.org> on 2023/05/02 03:50:15 UTC
[GitHub] [airflow] clementchane opened a new issue, #31005: DAGs not running, cannot retrieve any logs.
clementchane opened a new issue, #31005:
URL: https://github.com/apache/airflow/issues/31005
### Official Helm Chart version
1.9.0 (latest released)
### Apache Airflow version
2.5.3
### Kubernetes Version
Client Version: v1.26.0 Kustomize Version: v4.5.7 Server Version: v1.25.6
### Helm Chart configuration
Basic values file
fernetKey: ~
webserverSecretKey: ~
images:
airflow:
repository: privaterepo/airflow
tag: v0.5
scheduler:
livenessProbe:
initialDelaySeconds: 30
timeoutSeconds: 60
failureThreshold: 5
periodSeconds: 60
env:
- name: "AIRFLOW_VAR_."
value: "#{...}#"
registry:
secretName: ...
### Docker Image customizations
FROM apache/airflow:2.5.3
USER root
RUN apt-get update \
&& apt-get install -y --no-install-recommends \
vim \
&& apt-get autoremove -yqq --purge \
&& apt-get clean \
&& rm -rf /var/lib/apt/lists/*
USER airflow
RUN python -m pip install --upgrade pip \
&& pip install airflow-code-editor \
&& pip install black fs-s3fs fs-gcsfs requests PyGithub psycopg2 datetime cryptography==38.0.4 xlrd==1.2.0 pygithub jaydebeapi ndpmetadata
ENTRYPOINT [ "/usr/bin/dumb-init","--","/entrypoint" ]
### What happened
Installation seems to work fine, my DAGs, variables, and modules appear in the UI.
However I cannot run anything, and I have no logs.
I did not find any relevant logs in the webserver/scheduler pods
<img width="631" alt="image" src="https://user-images.githubusercontent.com/112370548/235575018-2cb26b39-d1d0-4f22-9694-66dec7d66008.png">
<img width="653" alt="image" src="https://user-images.githubusercontent.com/112370548/235575145-5f7bbbd8-7b61-45de-93ec-e1f8d30d636d.png">
### What you think should happen instead
At least have some logs on why DAGs failed.
### How to reproduce
Install apache-airflow/airflow v2.5.3 helm charts.
Added a DAG directly in the webserver dags folder.
Dag is never running, I have reinstalled several times, but never managed to get logs in Airflow.
### Anything else
I have tried to look in all the closed issues or discussions, but hard to find any clear answers on why do I get no logs.
I dont have tried looking at pod logs and events but nothing happens.
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #31005: DAGs not running, cannot retrieve any logs.
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #31005: DAGs not running, cannot retrieve any logs.
URL: https://github.com/apache/airflow/issues/31005
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #31005: DAGs not running, cannot retrieve any logs.
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #31005:
URL: https://github.com/apache/airflow/issues/31005#issuecomment-1530831147
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org