You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/05/07 18:27:41 UTC
[GitHub] [airflow] aarrtteemmuuss opened a new issue #8770: Airflow 1.10.7 logs from S3 won't load, just hanging
aarrtteemmuuss opened a new issue #8770:
URL: https://github.com/apache/airflow/issues/8770
**Apache Airflow version**: 1.10.7
**Environment**: python 3.7, running locally
**What happened**:
I have following configuration in airflow.cfg:
`remote_logging = True`
`remote_log_conn_id = "S3Connection"`
`remote_base_log_folder = s3://bucket/logs`
`encrypt_s3_logs = False`
I have setup connection in UI with type S3 and following settings:
`{"aws_access_key_id":"xxx", "aws_secret_access_key": "xxx"}`
Executor is LocalExecutor. Scheduler is able to write logs to S3, but when I open UI to look for task's logs, I can see its just hanging and nothing is happening. The spin spins forever and I can't even see that is the error.
`http://127.0.0.1:8080/admin/airflow/get_logs_with_metadata?dag_id=example_bash_operator&task_id=run_after_loop&execution_date=2020-05-07T18%3A08%3A51.232255%2B00%3A00&try_number=1&metadata=null` - returns Empty Response Error and nothing works.
Am I doing something wrong? Because S3 configuration is not good documented and I see bunch of reports that it is not working.
**What you expected to happen**:
I expected logs to be pulled from S3 and shown in UI admin.
**How to reproduce it**:
Install airflow 1.10.7 locally and run any example dag with remote settings enables for S3 bucket.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] feluelle commented on issue #8770: Airflow 1.10.7 logs from S3 won't load, just hanging
Posted by GitBox <gi...@apache.org>.
feluelle commented on issue #8770:
URL: https://github.com/apache/airflow/issues/8770#issuecomment-629176390
Can you try adding `"region":"your-s3-region"` to the extras and see if this helps?
Or remove the parenthesis from `remote_log_conn_id = "S3Connection"` -> S3Connection. So `S3Connection` is your connection id?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] aarrtteemmuuss commented on issue #8770: Airflow 1.10.7 logs from S3 won't load, just hanging
Posted by GitBox <gi...@apache.org>.
aarrtteemmuuss commented on issue #8770:
URL: https://github.com/apache/airflow/issues/8770#issuecomment-629233042
@feluelle I am actually using RBAC in k8s cluster, and there I am not even able to write to S3. How are RBAC and S3 logs related?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] feluelle edited a comment on issue #8770: Airflow 1.10.7 logs from S3 won't load, just hanging
Posted by GitBox <gi...@apache.org>.
feluelle edited a comment on issue #8770:
URL: https://github.com/apache/airflow/issues/8770#issuecomment-629176390
Can you try adding `"region":"your-s3-region"` to the extras and see if this helps?
Or remove the quotes from `remote_log_conn_id = "S3Connection"` -> S3Connection. So `S3Connection` is your connection id?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal commented on issue #8770: Airflow 1.10.7 logs from S3 won't load, just hanging
Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #8770:
URL: https://github.com/apache/airflow/issues/8770#issuecomment-821427992
@aarrtteemmuuss Since there are no reproduce steps to check the issue and there has been significant changes since you reported the issue I'm closing this.
If you are still experiencing problems after verifying against Airflow 2 + Amazon provider please let us know.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal closed issue #8770: Airflow 1.10.7 logs from S3 won't load, just hanging
Posted by GitBox <gi...@apache.org>.
eladkal closed issue #8770:
URL: https://github.com/apache/airflow/issues/8770
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ashb commented on issue #8770: Airflow 1.10.7 logs from S3 won't load, just hanging
Posted by GitBox <gi...@apache.org>.
ashb commented on issue #8770:
URL: https://github.com/apache/airflow/issues/8770#issuecomment-638060571
@aarrtteemmuuss See also #9118 -- can you try the debug steps there and see if it gives any indication of the problem.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] aarrtteemmuuss commented on issue #8770: Airflow 1.10.7 logs from S3 won't load, just hanging
Posted by GitBox <gi...@apache.org>.
aarrtteemmuuss commented on issue #8770:
URL: https://github.com/apache/airflow/issues/8770#issuecomment-629231295
@feluelle Not using RBAC because it is local setup, not in K8S cluster.
I have tried adding region and removing quotes - same result, I am actually able to write like I said, but not able to read from S3.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #8770: Airflow 1.10.7 logs from S3 won't load, just hanging
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #8770:
URL: https://github.com/apache/airflow/issues/8770#issuecomment-625422513
Thanks for opening your first issue here! Be sure to follow the issue template!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] feluelle commented on issue #8770: Airflow 1.10.7 logs from S3 won't load, just hanging
Posted by GitBox <gi...@apache.org>.
feluelle commented on issue #8770:
URL: https://github.com/apache/airflow/issues/8770#issuecomment-629177661
You are not using RBAC, right?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org