Scanning from JVM (newbie question)

[Luis Otero <lo...@gmail.com>]

Hi list,

Documentation about scanning iceberg tables from jvm (
https://iceberg.apache.org/api/#scanning) doesn't mention handy
IcebergGenerics (
https://github.com/apache/incubator-iceberg/blob/master/data/src/main/java/org/apache/iceberg/data/IcebergGenerics.java)
that (apart from missing time travel support) looks the natural way to go.

Is that intentional (IcebergGenerics is a dead-end) or just an oversight?

Thanks,
L.

Re: Scanning from JVM (newbie question)

[Ryan Blue <rb...@netflix.com.INVALID>]

Hi Luis,

`IcebergGenerics` are a good way for a client to read an Iceberg table, but
that doesn't run the scan in parallel. Since most people are interested in
building Iceberg into engines like Presto and Spark, the documentation is
at a slightly lower level: it explains how to configure Iceberg to return
tasks that will be run by a database engine.

I think it would be good to have an additional page about reading from a
single client. Would you like to contribute a doc about reading a table
from a Java program using `IcebergGenerics`?

rb

On Sun, Jan 19, 2020 at 5:50 AM Luis Otero <lo...@gmail.com> wrote:

> Hi list,
>
> Documentation about scanning iceberg tables from jvm (
> https://iceberg.apache.org/api/#scanning) doesn't mention handy
> IcebergGenerics (
> https://github.com/apache/incubator-iceberg/blob/master/data/src/main/java/org/apache/iceberg/data/IcebergGenerics.java)
> that (apart from missing time travel support) looks the natural way to go.
>
> Is that intentional (IcebergGenerics is a dead-end) or just an oversight?
>
> Thanks,
> L.
>


-- 
Ryan Blue
Software Engineer
Netflix