You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "santurini (via GitHub)" <gi...@apache.org> on 2025/07/07 09:07:02 UTC
[I] All dags failing with: Request URL is missing an 'http://' or 'https://' protocol. ERROR [airflow]
santurini opened a new issue, #52969:
URL: https://github.com/apache/airflow/issues/52969
### Official Helm Chart version
1.17.0 (latest released)
### Apache Airflow version
2.9.2
### Kubernetes Version
1.31
### Helm Chart configuration
```
airflowHome: /opt/airflow
defaultAirflowRepository: apache/airflow
defaultAirflowTag: "2.9.2"
airflowVersion: "2.9.2"
images:
airflow:
repository: ${IMAGE_NAME}
tag: ${VERSION}
env:
- name: "AIRFLOW__API__AUTH_BACKEND"
value: "airflow.api.auth.backend.basic_auth"
- name: "AIRFLOW__CORE__DAGS_ARE_PAUSED_AT_CREATION"
value: "True"
- name: "AIRFLOW__CORE__LOAD_EXAMPLES"
value: "False"
- name: AIRFLOW__CORE__EXECUTE_TASKS_NEW_PYTHON_INTERPRETER
value: "True"
- name: AIRFLOW__LOGGING__REMOTE_LOGGING
value: "True"
- name: AIRFLOW__LOGGING__REMOTE_LOG_CONN_ID
value: "LoggingS3Connection"
- name: AIRFLOW__LOGGING__REMOTE_BASE_LOG_FOLDER
value: "s3://logs-archive-product-team/Airflow"
- name: AIRFLOW__LOGGING__ENCRYPT_S3_LOGS
value: "False"
- name: AIRFLOW__CORE__ENABLE_XCOM_PICKLING
value: "True"
- name: AIRFLOW__SMTP__SMTP_HOST
value: "smtp.gmail.com"
- name: AIRFLOW__SMTP__SMTP_PORT
value: "587"
- name: AIRFLOW__SMTP__SMTP_SSL
value: "False"
- name: AIRFLOW__SMTP__SMTP_STARTTLS
value: "True"
secret:
- envName: "GIT_TOKEN"
secretName: "airflow-git-token"
secretKey: "GIT_TOKEN"
- envName: "AWS_ACCESS_KEY_ID"
secretName: "airflow-aws"
secretKey: "AWS_ACCESS_KEY_ID"
- envName: "AWS_SECRET_ACCESS_KEY"
secretName: "airflow-aws"
secretKey: "AWS_SECRET_ACCESS_KEY"
- envName: "AWS_ACCESS_KEY_ID_DATASETS"
secretName: "airflow-aws"
secretKey: "AWS_ACCESS_KEY_ID_DATASETS"
- envName: "AWS_SECRET_ACCESS_KEY_DATASETS"
secretName: "airflow-aws"
secretKey: "AWS_SECRET_ACCESS_KEY_DATASETS"
- envName: "FRONT_TOKEN"
secretName: "airflow-connections"
secretKey: "FRONT_TOKEN"
- envName: "ASANA_TOKEN"
secretName: "airflow-connections"
secretKey: "ASANA_TOKEN"
- envName: "SLACK_TOKEN"
secretName: "airflow-connections"
secretKey: "SLACK_TOKEN"
- envName: "AIRFLOW__SMTP__SMTP_PASSWORD"
secretName: "airflow-connections"
secretKey: "AIRFLOW__SMTP__SMTP_PASSWORD"
- envName: "AWS_BUCKET_MODEL"
secretName: "airflow-aws"
secretKey: "AWS_BUCKET_MODEL"
- envName: "AWS_REGION_NAME"
secretName: "airflow-aws"
secretKey: "AWS_REGION_NAME"
- envName: "REDIS_PASSWORD"
secretName: "airflow-connections"
secretKey: "REDIS_PASSWORD"
- envName: "AIRFLOW_REDIS_URL"
secretName: "airflow-connections"
secretKey: "AIRFLOW_REDIS_URL"
data:
metadataConnection:
user: airflow
pass: ${AIRFLOW_DB_PASSWORD}
protocol: postgresql
host: postgres-prod.domain.com
port: 5432
db: airflow
sslmode: disable
brokerUrl: ${AIRFLOW_REDIS_URL}
fernetKey: ${FERNET_KEY}
dags:
gitSync:
enabled: true
repo: git@github.com:repo/airflow-dags.git
branch: master
ref: master
depth: 1
subPath: "dags"
sshKeySecret: airflow-ssh-secret
### Docker Image customizations
```
FROM apache/airflow:2.9.2-python3.11
ARG GIT_TOKEN
ENV GIT_TOKEN=$GIT_TOKEN
USER root
RUN apt-get update && apt-get install -y git
RUN apt-get install g++ -y
USER $AIRFLOW_UID
```
### What happened
I did an airflow fresh installation (new redis and postgre db) importing variables and connections from a previous version, and now almost all the dags fail with only these logs:
```
*** No logs found on s3 for ti=<TaskInstance: enterprise_ops_quality_report_v2.get_variables manual__2025-07-07T08:47:24.269460+00:00 [failed]>
*** Could not read served logs: Request URL is missing an 'http://'/ or 'https://'/ protocol.
```
I am no more able to make a succesfull DAG run, while before I had no problems at all.
### What you think should happen instead
_No response_
### How to reproduce
Install airflow with provided helm values and try a DAG run.
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] All dags failing with: Request URL is missing an 'http://' or 'https://' protocol. ERROR [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #52969: All dags failing with: Request URL is missing an 'http://' or 'https://' protocol. ERROR
URL: https://github.com/apache/airflow/issues/52969
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] All dags failing with: Request URL is missing an 'http://' or 'https://' protocol. ERROR [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #52969:
URL: https://github.com/apache/airflow/issues/52969#issuecomment-3134470609
This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] All dags failing with: Request URL is missing an 'http://' or 'https://' protocol. ERROR [airflow]
Posted by "santurini (via GitHub)" <gi...@apache.org>.
santurini commented on issue #52969:
URL: https://github.com/apache/airflow/issues/52969#issuecomment-3048249703
I am running on kubernetes, now the problem has fixed by itself but I'm scared it will happen again.
I am sharing the logs files.
[airflow-scheduler-7698d44b6b-7v8kh_logs.txt](https://github.com/user-attachments/files/21119612/airflow-scheduler-7698d44b6b-7v8kh_logs.txt)
[airflow-worker-0_logs.txt](https://github.com/user-attachments/files/21119611/airflow-worker-0_logs.txt)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] All dags failing with: Request URL is missing an 'http://' or 'https://' protocol. ERROR [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #52969:
URL: https://github.com/apache/airflow/issues/52969#issuecomment-3162007264
This issue has been closed because it has not received response from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] All dags failing with: Request URL is missing an 'http://' or 'https://' protocol. ERROR [airflow]
Posted by "jroachgolf84 (via GitHub)" <gi...@apache.org>.
jroachgolf84 commented on issue #52969:
URL: https://github.com/apache/airflow/issues/52969#issuecomment-3045711267
Can you share your Scheduler/Worker logs? How are you running this? Locally?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] All dags failing with: Request URL is missing an 'http://' or 'https://' protocol. ERROR [airflow]
Posted by "jroachgolf84 (via GitHub)" <gi...@apache.org>.
jroachgolf84 commented on issue #52969:
URL: https://github.com/apache/airflow/issues/52969#issuecomment-3048564826
This is something that I see a good bit. This normally happens when your Task instance is killed unexpectedly (OOMKill) and isn't able to write logs to S3/blob storage. Here's the snippet in the codebase that handles this.
Can you validate that there are in fact logs in S3 for this Task instance?
```python
def _read_from_logs_server(self, ti, worker_log_rel_path) -> tuple[LogSourceInfo, LogMessages]:
sources = []
logs = []
try:
log_type = LogType.TRIGGER if ti.triggerer_job else LogType.WORKER
url, rel_path = self._get_log_retrieval_url(ti, worker_log_rel_path, log_type=log_type)
response = _fetch_logs_from_service(url, rel_path)
if response.status_code == 403:
sources.append(
"!!!! Please make sure that all your Airflow components (e.g. "
"schedulers, webservers, workers and triggerer) have "
"the same 'secret_key' configured in 'webserver' section and "
"time is synchronized on all your machines (for example with ntpd)\n"
"See more at https://airflow.apache.org/docs/apache-airflow/"
"stable/configurations-ref.html#secret-key"
)
else:
# Check if the resource was properly fetched
response.raise_for_status()
if response.text:
sources.append(url)
logs.append(response.text)
except Exception as e:
from requests.exceptions import InvalidURL
if isinstance(e, InvalidURL) and ti.task.inherits_from_empty_operator is True:
sources.append(self.inherits_from_empty_operator_log_message)
else:
sources.append(f"Could not read served logs: {e}")
logger.exception("Could not read served logs")
return sources, logs
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org