In-memory implementation of FileIO

[Mayur Srivastava <Ma...@twosigma.com>]

Hi,

Is there an in-memory implementation of the FileIO interface?
I'm looking for one for writing unit tests (basically avoiding touching local file system or other external resources).

Thanks,
Mayur

RE: In-memory implementation of FileIO

[Mayur Srivastava <Ma...@twosigma.com>]

Hi Ryan,

I have put together an in-memory FileIO and in-memory Catalog in this pr https://github.com/apache/iceberg/pull/3294.

Thanks,
Mayur

From: Ryan Blue <bl...@tabular.io>
Sent: Monday, September 27, 2021 11:13 AM
To: Iceberg Dev List <de...@iceberg.apache.org>
Subject: Re: In-memory implementation of FileIO

I don't think so. There's one that wraps the local file system we use for testing that at least doesn't depend on Hadoop though. If you want to build an in-memory one that would be great.

On Mon, Sep 27, 2021 at 7:32 AM Mayur Srivastava <Ma...@twosigma.com>> wrote:
Hi,

Is there an in-memory implementation of the FileIO interface?
I’m looking for one for writing unit tests (basically avoiding touching local file system or other external resources).

Thanks,
Mayur



--
Ryan Blue
Tabular

Re: In-memory implementation of FileIO

[Ryan Blue <bl...@tabular.io>]

I don't think so. There's one that wraps the local file system we use for
testing that at least doesn't depend on Hadoop though. If you want to build
an in-memory one that would be great.

On Mon, Sep 27, 2021 at 7:32 AM Mayur Srivastava <
Mayur.Srivastava@twosigma.com> wrote:

> Hi,
>
>
>
> Is there an in-memory implementation of the FileIO interface?
>
> I’m looking for one for writing unit tests (basically avoiding touching
> local file system or other external resources).
>
>
>
> Thanks,
> Mayur
>
>
>


-- 
Ryan Blue
Tabular