[jira] [Commented] (HUDI-1407) Pandas(python) integration w/ Apache Hudi

["Charlie Briggs (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685887#comment-17685887 ] 

Charlie Briggs commented on HUDI-1407:
--------------------------------------

It'd be fantastic to see this support added to remove the need to use Spark as an intermediate job to run generic Python workloads.

It's worth noting that:

Apache Iceberg supports reading into Apache Arrow: [https://py.iceberg.apache.org/api]
Deltalake supports reading into Apache Arrow [https://delta-io.github.io/delta-rs/python/api_reference.html#deltalake.table.DeltaTable.to_pyarrow_table]

These both also enable easy export into other engines, such as [DuckDB|https://duckdb.org/] (although Iceberg also supports this directly via the pyiceberg API).

> Pandas(python) integration w/ Apache Hudi
> -----------------------------------------
>
>                 Key: HUDI-1407
>                 URL: https://issues.apache.org/jira/browse/HUDI-1407
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: deltastreamer
>            Reporter: sivabalan narayanan
>            Priority: Major
>              Labels: gsoc, gsoc2021, mentor
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)