You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Rafael (JIRA)" <ji...@apache.org> on 2016/05/19 11:30:13 UTC
[jira] [Updated] (AIRFLOW-139) Executing VACUUM with
PostgresOperator
[ https://issues.apache.org/jira/browse/AIRFLOW-139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rafael updated AIRFLOW-139:
---------------------------
Description:
Dear Airflow Maintainers,
h1 Environment
* Airflow version: *v1.7.0*
* Airflow components: *PostgresOperator*
* Python Version: *Python 3.5.1*
* Operating System: *15.4.0 Darwin*
Description of Issue
I am trying to execute a `VACUUM` command as part of DAG with the `PostgresOperator`, which fails with the following error:
```
[2016-05-14 16:14:01,849] {__init__.py:36} INFO - Using executor SequentialExecutor
Traceback (most recent call last):
File "/usr/local/bin/airflow", line 15, in <module>
args.func(args)
File "/usr/local/Cellar/python3/3.5.1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/airflow/bin/cli.py", line 203, in run
pool=args.pool,
File "/usr/local/Cellar/python3/3.5.1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/airflow/models.py", line 1067, in run
result = task_copy.execute(context=context)
File "/usr/local/lib/python3.5/site-packages/airflow/operators/postgres_operator.py", line 39, in execute
self.hook.run(self.sql, self.autocommit, parameters=self.parameters)
File "/usr/local/Cellar/python3/3.5.1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/airflow/hooks/dbapi_hook.py", line 109, in run
cur.execute(s)
psycopg2.InternalError: VACUUM cannot run inside a transaction block
```
I could create a small python script that performs the operation, as explained in [this stackoverflow entry](http://stackoverflow.com/questions/1017463/postgresql-how-to-run-vacuum-from-code-outside-transaction-block). However, I would like to know first if the `VACUUM` command should be supported by the `PostgresOperator`.
### Reproducing the Issue
The operator can be declared as follows:
```
conn = ('postgres_default')
t4 = PostgresOperator(
task_id='vacuum',
postgres_conn_id=conn,
sql=("VACUUM public.table"),
dag=dag
)
```
was:
Dear Airflow Maintainers,
### Environment
* Airflow version: *v1.7.0*
* Airflow components: *PostgresOperator*
* Python Version: *Python 3.5.1*
* Operating System: *15.4.0 Darwin*
### Description of Issue
I am trying to execute a `VACUUM` command as part of DAG with the `PostgresOperator`, which fails with the following error:
```
[2016-05-14 16:14:01,849] {__init__.py:36} INFO - Using executor SequentialExecutor
Traceback (most recent call last):
File "/usr/local/bin/airflow", line 15, in <module>
args.func(args)
File "/usr/local/Cellar/python3/3.5.1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/airflow/bin/cli.py", line 203, in run
pool=args.pool,
File "/usr/local/Cellar/python3/3.5.1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/airflow/models.py", line 1067, in run
result = task_copy.execute(context=context)
File "/usr/local/lib/python3.5/site-packages/airflow/operators/postgres_operator.py", line 39, in execute
self.hook.run(self.sql, self.autocommit, parameters=self.parameters)
File "/usr/local/Cellar/python3/3.5.1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/airflow/hooks/dbapi_hook.py", line 109, in run
cur.execute(s)
psycopg2.InternalError: VACUUM cannot run inside a transaction block
```
I could create a small python script that performs the operation, as explained in [this stackoverflow entry](http://stackoverflow.com/questions/1017463/postgresql-how-to-run-vacuum-from-code-outside-transaction-block). However, I would like to know first if the `VACUUM` command should be supported by the `PostgresOperator`.
### Reproducing the Issue
The operator can be declared as follows:
```
conn = ('postgres_default')
t4 = PostgresOperator(
task_id='vacuum',
postgres_conn_id=conn,
sql=("VACUUM public.table"),
dag=dag
)
```
> Executing VACUUM with PostgresOperator
> --------------------------------------
>
> Key: AIRFLOW-139
> URL: https://issues.apache.org/jira/browse/AIRFLOW-139
> Project: Apache Airflow
> Issue Type: Bug
> Affects Versions: Airflow 1.7.0
> Reporter: Rafael
>
> Dear Airflow Maintainers,
> h1 Environment
> * Airflow version: *v1.7.0*
> * Airflow components: *PostgresOperator*
> * Python Version: *Python 3.5.1*
> * Operating System: *15.4.0 Darwin*
> Description of Issue
> I am trying to execute a `VACUUM` command as part of DAG with the `PostgresOperator`, which fails with the following error:
> ```
> [2016-05-14 16:14:01,849] {__init__.py:36} INFO - Using executor SequentialExecutor
> Traceback (most recent call last):
> File "/usr/local/bin/airflow", line 15, in <module>
> args.func(args)
> File "/usr/local/Cellar/python3/3.5.1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/airflow/bin/cli.py", line 203, in run
> pool=args.pool,
> File "/usr/local/Cellar/python3/3.5.1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/airflow/models.py", line 1067, in run
> result = task_copy.execute(context=context)
> File "/usr/local/lib/python3.5/site-packages/airflow/operators/postgres_operator.py", line 39, in execute
> self.hook.run(self.sql, self.autocommit, parameters=self.parameters)
> File "/usr/local/Cellar/python3/3.5.1/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/airflow/hooks/dbapi_hook.py", line 109, in run
> cur.execute(s)
> psycopg2.InternalError: VACUUM cannot run inside a transaction block
> ```
> I could create a small python script that performs the operation, as explained in [this stackoverflow entry](http://stackoverflow.com/questions/1017463/postgresql-how-to-run-vacuum-from-code-outside-transaction-block). However, I would like to know first if the `VACUUM` command should be supported by the `PostgresOperator`.
> ### Reproducing the Issue
> The operator can be declared as follows:
> ```
> conn = ('postgres_default')
> t4 = PostgresOperator(
> task_id='vacuum',
> postgres_conn_id=conn,
> sql=("VACUUM public.table"),
> dag=dag
> )
> ```
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)