You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2019/12/27 21:34:55 UTC
[GitHub] [airflow] mik-laj commented on a change in pull request #6930:
[AIRFLOW-6372] Align Azure Blob Storage remote logging URI scheme
mik-laj commented on a change in pull request #6930: [AIRFLOW-6372] Align Azure Blob Storage remote logging URI scheme
URL: https://github.com/apache/airflow/pull/6930#discussion_r361749492
##########
File path: docs/howto/write-logs.rst
##########
@@ -72,36 +72,19 @@ In the above example, Airflow will try to use ``S3Hook('MyS3Conn')``.
Writing Logs to Azure Blob Storage
----------------------------------
-Airflow can be configured to read and write task logs in Azure Blob Storage.
-
Follow the steps below to enable Azure Blob Storage logging:
-#. Airflow's logging system requires a custom ``.py`` file to be located in the ``PYTHONPATH``, so that it's importable from Airflow. Start by creating a directory to store the config file, ``$AIRFLOW_HOME/config`` is recommended.
-#. Create empty files called ``$AIRFLOW_HOME/config/log_config.py`` and ``$AIRFLOW_HOME/config/__init__.py``.
-#. Copy the contents of ``airflow/config_templates/airflow_local_settings.py`` into the ``log_config.py`` file created in ``Step 2``.
-#. Customize the following portions of the template:
-
- .. code-block:: ini
-
- # wasb buckets should start with "wasb" just to help Airflow select correct handler
- REMOTE_BASE_LOG_FOLDER = 'wasb-<whatever you want here>'
-
- # Rename DEFAULT_LOGGING_CONFIG to LOGGING CONFIG
- LOGGING_CONFIG = ...
-
-
-#. Make sure a Azure Blob Storage (Wasb) connection hook has been defined in Airflow. The hook should have read and write access to the Azure Blob Storage bucket defined above in ``REMOTE_BASE_LOG_FOLDER``.
-
-#. Update ``$AIRFLOW_HOME/airflow.cfg`` to contain:
-
- .. code-block:: bash
+.. code-block:: ini
- remote_logging = True
- logging_config_class = log_config.LOGGING_CONFIG
- remote_log_conn_id = <name of the Azure Blob Storage connection>
+ [core]
Review comment:
```suggestion
[logging]
```
Recently these options have been moved.
https://github.com/apache/airflow/pull/6887
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services