You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Xianping lin (JIRA)" <ji...@apache.org> on 2017/04/27 03:03:04 UTC

[jira] [Created] (AIRFLOW-1153) params in HiveOperator constructor can't be passed into Hive execution context

Xianping lin created AIRFLOW-1153:
-------------------------------------

             Summary: params in HiveOperator constructor can't be passed into Hive execution context
                 Key: AIRFLOW-1153
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1153
             Project: Apache Airflow
          Issue Type: Bug
          Components: hive_hooks, operators
    Affects Versions: Airflow 2.0, Airflow 1.8
            Reporter: Xianping lin
            Priority: Critical


params parameter in HiveOperator can't be imported into Hive executation context.
    so the following centence won't work, because 'mynumber' doesn't work for sql sentence.
    test_hiveoperator = HiveOperator(
        task_id='hive_test',
        hiveconf_jinja_translate=True,
        hql = ''' use myDB;
            INSERT OVERWRITE TABLE t2
            select * from t1 where t1.x > ' ${hiveconf:mynumber}'
        ''',
        params={'mynumber': 2},
        dag=dag
    )

    this modification pass the 'params' in HiveOperator construction to Hive sql execution context.
    The the variable definition can pass to hive sql



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)