You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "l1t1 (via GitHub)" <gi...@apache.org> on 2024/02/20 22:30:23 UTC
[I] datafusion-cli not installed [arrow-datafusion]
l1t1 opened a new issue, #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294
### Describe the bug
https://arrow.apache.org/datafusion/user-guide/cli.html
the CLI cannot run
```
datafusion-cli
-bash: datafusion-cli: command not found
```
### To Reproduce
pip install datafusion
datafusion-cli
### Expected behavior
the CLI runs
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "andygrove (via GitHub)" <gi...@apache.org>.
andygrove commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-2027560667
I left a comment on https://github.com/apache/arrow-datafusion/pull/9452#issuecomment-2027555738
DataFusion is a Rust project and datafusion-cli is already available via cargo, which is the default packaging manager for Rust. If we want to use Python packaging for datafusion-cli, it seems logical to do that in the DataFusion Python repository.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "MohamedAbdeen21 (via GitHub)" <gi...@apache.org>.
MohamedAbdeen21 commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-1987167789
Hey @l1t1 the current datafusion-cli on PyPI is meant to be a test, it's not automated for future releases as the PR is not yet merged. I'd appreciate if you can re-open the issue to be closed after the PR is merged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "l1t1 (via GitHub)" <gi...@apache.org>.
l1t1 closed issue #9294: datafusion-cli not installed
URL: https://github.com/apache/arrow-datafusion/issues/9294
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "Weijun-H (via GitHub)" <gi...@apache.org>.
Weijun-H commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-1956462619
> Actually, does the datafusion pypi package even include datafusion-cli in the first place? 🤔
>
> I did a quick search through [apache/arrow-datafusion-python](https://github.com/apache/arrow-datafusion-python) and found no actual mention of datafusion-cli (though in fairness I'm not familiar with that repo or the process of packaging a Python package)
>
> Maybe the documentation on that CLI user guide page is mistaken on that account? Relevant PR: #8389
>
> cc @Weijun-H
After checking the documentation in [apache/arrow-datafusion-python](https://github.com/apache/arrow-datafusion-python), I discovered that the current PyPi installation for CLI is incorrect @Jefffrey . Perhaps it's time to implement `pip install datafusion-cli` 🤔 ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "viirya (via GitHub)" <gi...@apache.org>.
viirya commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-1955534734
datafusion-cli is in this repo. I meant its pypi packaging and release should be done at https://github.com/apache/arrow-datafusion-python.
I think the issue is not datafusion-cli itself or its functionality but the pypi package issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "viirya (via GitHub)" <gi...@apache.org>.
viirya commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-1955248771
Hmm, I think this issue may move to https://github.com/apache/arrow-datafusion-python?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "l1t1 (via GitHub)" <gi...@apache.org>.
l1t1 closed issue #9294: datafusion-cli not installed
URL: https://github.com/apache/arrow-datafusion/issues/9294
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [datafusion]
Posted by "l1t1 (via GitHub)" <gi...@apache.org>.
l1t1 commented on issue #9294:
URL: https://github.com/apache/datafusion/issues/9294#issuecomment-2111399270
version 37.1.0 still has the issue
```
D:\>pip install datafusion -U
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Requirement already satisfied: datafusion in d:\python38\lib\site-packages (36.0.0)
Collecting datafusion
Downloading https://pypi.tuna.tsinghua.edu.cn/packages/90/7e/09877d816952ff90f2bdcd49c45b199e20b226708068fa6a5bfb7d8ed51a/datafusion-37.1.0-cp38-abi3-win_amd64.whl (16.8 MB)
---------------------------------------- 16.8/16.8 MB 40.9 MB/s eta 0:00:00
Requirement already satisfied: pyarrow>=11.0.0 in d:\python38\lib\site-packages (from datafusion) (15.0.0)
Requirement already satisfied: numpy<2,>=1.16.6 in d:\python38\lib\site-packages (from pyarrow>=11.0.0->datafusion) (1.21.0)
Installing collected packages: datafusion
Attempting uninstall: datafusion
Found existing installation: datafusion 36.0.0
Uninstalling datafusion-36.0.0:
Successfully uninstalled datafusion-36.0.0
Successfully installed datafusion-37.1.0
D:\mathhigh>datafusion-cli
DataFusion CLI v36.0.0
❯
\q
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "l1t1 (via GitHub)" <gi...@apache.org>.
l1t1 commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-1955403925
thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "Jefffrey (via GitHub)" <gi...@apache.org>.
Jefffrey commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-1956340222
Actually, does the datafusion pypi package even include datafusion-cli in the first place? :thinking:
I did a quick search through https://github.com/apache/arrow-datafusion-python and found no actual mention of datafusion-cli (though in fairness I'm not familiar with that repo or the process of packaging a Python package)
Maybe the documentation on that CLI user guide page is mistaken on that account? Relevant PR: https://github.com/apache/arrow-datafusion/pull/8389
cc @Weijun-H
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [datafusion]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead commented on issue #9294:
URL: https://github.com/apache/datafusion/issues/9294#issuecomment-2627807294
Closing the issue as it doesn't seem to require any actions anymore, feel free to reopen if needed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "l1t1 (via GitHub)" <gi...@apache.org>.
l1t1 commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-1985025124
`pip install datafusion-cli` works now, thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "viirya (via GitHub)" <gi...@apache.org>.
viirya commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-1955536609
Anyway, it is okay to keep it open to get visibility. :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-1956132102
I think there is a brew package if you are on Mac:
```bash
brew install datafusion
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [datafusion]
Posted by "MohamedAbdeen21 (via GitHub)" <gi...@apache.org>.
MohamedAbdeen21 commented on issue #9294:
URL: https://github.com/apache/datafusion/issues/9294#issuecomment-2118859061
Hey @l1t1, as per Andy's comments on #9452, datafusion-cli releases should be handled in the python repo.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "l1t1 (via GitHub)" <gi...@apache.org>.
l1t1 commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-1955242123
python module works
```python
python3
Python 3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import datafusion
>>> datafusion.__version__
'35.0.0'
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [arrow-datafusion]
Posted by "SteveLauC (via GitHub)" <gi...@apache.org>.
SteveLauC commented on issue #9294:
URL: https://github.com/apache/arrow-datafusion/issues/9294#issuecomment-1958806265
> Perhaps it's time to implement pip install datafusion-cli
I am not sure how DataFusion release procedure works, but if you automate it in CI, [maturin](https://github.com/PyO3/maturin) can help.
> I have done [this](https://github.com/topgrade-rs/topgrade/pull/500/files#diff-50c86b7ed8ac2cf95bd48334961bf0530cdc77b5a56f852c5c61b89d735fd711) to `Topgrade`, take a look at this PR if you want to see a real-world example on how it looks like.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] datafusion-cli not installed [datafusion]
Posted by "comphead (via GitHub)" <gi...@apache.org>.
comphead closed issue #9294: datafusion-cli not installed
URL: https://github.com/apache/datafusion/issues/9294
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org