You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Li Cheng (Jira)" <ji...@apache.org> on 2019/11/08 02:32:00 UTC
[jira] [Created] (HDDS-2443) Python client/interface for Ozone
Li Cheng created HDDS-2443:
------------------------------
Summary: Python client/interface for Ozone
Key: HDDS-2443
URL: https://issues.apache.org/jira/browse/HDDS-2443
Project: Hadoop Distributed Data Store
Issue Type: New Feature
Components: Ozone Client
Reporter: Li Cheng
Original ideas:
Ozone Client(Python) for Data Science Notebook such as Jupyter.
# Size: Large
# PyArrow: [https://pypi.org/project/pyarrow/]
# Python -> libhdfs HDFS JNI library (HDFS, S3,...) -> Java client API Impala uses libhdfs
# How Jupyter iPython work: [https://jupyter.readthedocs.io/en/latest/architecture/how_jupyter_ipython_work.html]
# Eco, Architecture:[https://ipython-books.github.io/chapter-3-mastering-the-jupyter-notebook/]
Path to try:
1. s3 interface: Ozone s3 gateway(already supported) + AWS python client (boto3)
2. python native RPC
3. pyarrow + libhdfs, which use the Java client under the hood.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org