You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by twinkle sachdeva <tw...@gmail.com> on 2016/10/27 09:09:06 UTC
retry handler not getting called
Hi,
I am working with a hiveToMySql transfer operation, which is not able to
connect and gives following logs:
HiveServer2Error: Failed after retrying 3 times
[2016-10-27 01:54:46,524] {models.py:1298} INFO - Marking task as
UP_FOR_RETRY
As per the code in the models.py,
https://github.com/apache/incubator-airflow/blob/master/airflow/models.py#L1347
, it should be calling the code for retry handler ( we are using version
1.7.1.3), but it is not happening.
Here is the relevant code snippet:
def my_retry_handler(context):
print "my_retry_handler called" slack_retry_notification =
SlackAPIPostOperator( task_id='Slack_Failure_Notification',
token="XXXXXX",
channel='@yyyyyy',
text=":skull: - {time} - {dag} attempt has been failed
".format(dag='Some Dag',time=datetime.now().strftime("%Y-%m-%d %H:%M:%S"),
),
owner='Retry Handler')
return slack_retry_notification.execute
hiveToMySql = HiveToMYSQLTransfer(sql="jdbsd", hiveserver2_conn_id='
hiveserver2_default',.........
on_retry_callback=my_retry_handler)
Is there something i am missing?
Regards,
Twinkle
Re: retry handler not getting called
Posted by twinkle sachdeva <tw...@gmail.com>.
Please ignore.
It is being called.
On Thu, Oct 27, 2016 at 2:39 PM, twinkle sachdeva <
twinkle.sachdeva@gmail.com> wrote:
> Hi,
>
> I am working with a hiveToMySql transfer operation, which is not able to
> connect and gives following logs:
>
> HiveServer2Error: Failed after retrying 3 times
>
> [2016-10-27 01:54:46,524] {models.py:1298} INFO - Marking task as
> UP_FOR_RETRY
>
>
> As per the code in the models.py, https://github.com/apache/
> incubator-airflow/blob/master/airflow/models.py#L1347 , it should be
> calling the code for retry handler ( we are using version 1.7.1.3), but it
> is not happening.
>
>
> Here is the relevant code snippet:
>
>
> def my_retry_handler(context):
>
> print "my_retry_handler called" slack_retry_notification =
> SlackAPIPostOperator( task_id='Slack_Failure_Notification',
>
> token="XXXXXX",
>
> channel='@yyyyyy',
>
> text=":skull: - {time} - {dag} attempt has been failed
> ".format(dag='Some Dag',time=datetime.now().strftime("%Y-%m-%d %H:%M:%S"),
> ),
>
> owner='Retry Handler')
>
> return slack_retry_notification.execute
>
>
> hiveToMySql = HiveToMYSQLTransfer(sql="jdbsd", hiveserver2_conn_id='hivese
> rver2_default',.........
>
> on_retry_callback=my_retry_handler)
>
>
> Is there something i am missing?
>
>
>
> Regards,
>
> Twinkle
>