You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/06/16 11:57:49 UTC
[GitHub] [airflow] yash64 opened a new issue #9328: unable to install papermill provider
yash64 opened a new issue #9328:
URL: https://github.com/apache/airflow/issues/9328
I am trying to install papermill provider for airflow but i get an error. I am running airflow on Ubuntu 18.04. Below are the details
```
yaswanth@DESKTOP-TUTMG4J:~$ airflow version
1.10.10
yaswanth@DESKTOP-TUTMG4J:~$ python3 --version
Python 3.6.9
```
```
yaswanth@DESKTOP-TUTMG4J:~$ pip3 install apache-airflow-backport-providers-papermill
Collecting apache-airflow-backport-providers-papermill
Could not find a version that satisfies the requirement apache-airflow-backport-providers-papermill (from versions: )
No matching distribution found for apache-airflow-backport-providers-papermill
```
Just to check if any other providers with same requirements are also failing and I tried amazon provider
```
yaswanth@DESKTOP-TUTMG4J:~$ pip3 install apache-airflow-backport-providers-amazon
```
and this installed successfully but papermill is failing. Can someone please help on this.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] yash64 edited a comment on issue #9328: unable to install papermill provider
Posted by GitBox <gi...@apache.org>.
yash64 edited a comment on issue #9328:
URL: https://github.com/apache/airflow/issues/9328#issuecomment-645133841
@mik-laj Then how can I install PapermillOperator in Airflow 1.10? `pip3 install apache-airflow-backport-providers-papermill` was the suggested way but this is not working. Any other way?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #9328: unable to install papermill provider
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #9328:
URL: https://github.com/apache/airflow/issues/9328#issuecomment-644764766
Papermill provider has been removed from distributions. I will explain the reasons for all the removals in final documentation (I am planning to make a new RC today or tomorrow latest).
Current implementation of Papermill provider does not provide any advantage over the 1.10.* version except being tightly integrated with 2.0 way of lineage implementation which is backwards-incompatible with version 1.10. I hope we will have AIP-31 in place (Functional DAGs) that will enable to implement lineage in much more future-proof way, and then we might remove the current Papermill lineage approach and make the backport package for it released separately.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] yash64 commented on issue #9328: unable to install papermill provider
Posted by GitBox <gi...@apache.org>.
yash64 commented on issue #9328:
URL: https://github.com/apache/airflow/issues/9328#issuecomment-645791237
Thanks @mik-laj
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #9328: unable to install papermill provider
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #9328:
URL: https://github.com/apache/airflow/issues/9328#issuecomment-644717371
Thanks for opening your first issue here! Be sure to follow the issue template!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] yash64 commented on issue #9328: unable to install papermill provider
Posted by GitBox <gi...@apache.org>.
yash64 commented on issue #9328:
URL: https://github.com/apache/airflow/issues/9328#issuecomment-644774348
@potiuk Thanks for your reply. Does that mean PapermillOperator will not be available in future versions also? In case if it is not available, can you please help on other options available to schedule Jupyter notebooks using Airflow.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #9328: unable to install papermill provider
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #9328:
URL: https://github.com/apache/airflow/issues/9328#issuecomment-644863182
@yash64 This operator will still be available in Airflow 2.0 and 1.10. It will not be part of the backport packages.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] yash64 commented on issue #9328: unable to install papermill provider
Posted by GitBox <gi...@apache.org>.
yash64 commented on issue #9328:
URL: https://github.com/apache/airflow/issues/9328#issuecomment-645133841
@mik-laj Then how can I install papermill in Airflow 1.10? `pip3 install apache-airflow-backport-providers-papermill` was the suggested way but this is not working. Any other way?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #9328: unable to install papermill provider
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #9328:
URL: https://github.com/apache/airflow/issues/9328#issuecomment-645169649
You don't to install. It is available out-of-box: https://airflow.readthedocs.io/en/1.10.10/_api/airflow/operators/papermill_operator/index.html
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #9328: unable to install papermill provider
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #9328:
URL: https://github.com/apache/airflow/issues/9328
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org