You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/12/20 01:07:27 UTC

[GitHub] [airflow] mik-laj commented on a change in pull request #13190: Add system test for LocalToAzureDataLakeStorageOperator.

mik-laj commented on a change in pull request #13190:
URL: https://github.com/apache/airflow/pull/13190#discussion_r546304126



##########
File path: airflow/providers/microsoft/azure/example_dags/example_local_to_adls.py
##########
@@ -18,11 +18,19 @@
 import os
 
 from airflow import models
+from airflow.operators.python import PythonOperator
+from airflow.providers.microsoft.azure.hooks.azure_data_lake import AzureDataLakeHook
 from airflow.providers.microsoft.azure.transfers.local_to_adls import LocalToAzureDataLakeStorageOperator
 from airflow.utils.dates import days_ago
 
 LOCAL_FILE_PATH = os.environ.get("LOCAL_FILE_PATH", 'localfile.txt')
-REMOTE_FILE_PATH = os.environ.get("REMOTE_LOCAL_PATH", 'remote')
+REMOTE_FILE_PATH = os.environ.get("REMOTE_LOCAL_PATH", 'remote.txt')
+
+
+def remove_file():

Review comment:
       What do you think to add the operator that will do this action?  I think it would be good if the example DAGs did not include tricks with calling the Hook directly, but if possible they would use operators.




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org