You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/03/27 23:32:45 UTC

[GitHub] [airflow] dimberman opened a new issue #7930: How should I run task with owner not shell owner in AIRFLOW

dimberman opened a new issue #7930: How should I run task with  owner not shell owner in AIRFLOW
URL: https://github.com/apache/airflow/issues/7930
 
 
   
   
   **Apache Airflow version**:
   
   
   **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):
   
   **Environment**:
   
   - **Cloud provider or hardware configuration**:
   - **OS** (e.g. from /etc/os-release):
   - **Kernel** (e.g. `uname -a`):
   - **Install tools**:
   - **Others**:
   **What happened**:
   
   I dont understand the "owner" in airflow. the comment of ower is "the owner of the task, using the unix username is recommended". I wrote some the following code.
   
   Default_args = 
   {
   'owner': 'max',
   'depends_on_past': False,
   'start_date': datetime(2016, 7, 14),
   'email': ['max@test.com'],
   'email_on_failure': False,
   'email_on_retry': False,
   'retries': 1,
   'retry_delay': timedelta(minutes=5), 
   dag = DAG('dmp-annalect', default_args=default_args,
                       schedule_interval='30 0 * * *')
   
   
   task1_pigjob_basedata = """
   {local_dir}
   /src/basedata/basedata.sh > 
   {local_dir}
   /log/basedata/run_log &
   """.format(local_dir=WORKSPACE)
   
   task1_pigjob_basedata = BashOperator(
   task_id='task1_pigjob_basedata_impclk',owner='max',
   bash_command=pigjob_basedata_impclk,
   dag=dag)
   
    I used the command "airflow test dagid taskid 2016-07-20" , 
   
   But I got a error, 
   
   ... 
   {bash_operator.py:77}
    INFO - put: Permission denied: user=airflow, ....
   
   I thought that my job ran with "max" user, but apperently , ran test using 'airflow' user .
   
   I hope if I run my task using 'max' user, how should I do.
   
   Thanks
   
   **What you expected to happen**:
   
   
   **How to reproduce it**:
   
   
   **Anything else we need to know**:
   
   Moved here from https://issues.apache.org/jira/browse/AIRFLOW-357
       

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services