Table Export Question

["Timothy Hong (US)" <ti...@ptech-llc.com.INVALID>]

Hello,

Using Accumulo 1.10.2, I would like to bulk export a large table's data via the TableOperations::exportTable method. When I start copying the rfiles in distcp.txt is there any guarantee those rfiles will exist (as long as the cloned/offlined table exists)? I'm wondering if a system initiated major compaction might cause certain files to no longer be found.

Thank you,

Tim
CONFIDENTIALITY NOTICE: This e-mail is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure under applicable law. Any use, disclosure, distribution, or copying of this e-mail or the information contained herein by anyone other than the intended recipient is prohibited and may be a violation of state and/or Federal privacy laws. If you have received this e-mail in error, please delete any copies of it from your computer.

Re: EXTERNAL: Re: Table Export Question

["Timothy Hong (US)" <ti...@ptech-llc.com.INVALID>]

Great, thank you!
________________________________
From: Dave Marion <dm...@gmail.com>
Sent: Wednesday, November 20, 2024 4:59 PM
To: timothy.hong@ptech-llc.com.invalid <ti...@ptech-llc.com.invalid>
Cc: dev@accumulo.apache.org <de...@accumulo.apache.org>
Subject: EXTERNAL: Re: Table Export Question

[You don't often get email from dmarion18@gmail.com. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ]

Caution: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.


The garbage collector will not (should not) remove files for a table that
is cloned. Cloning a table, then offlining it for export I believe is the
recommended pattern.

On Wed, Nov 20, 2024 at 4:58 PM Timothy Hong (US)
<ti...@ptech-llc.com.invalid> wrote:

> Hello,
>
> Using Accumulo 1.10.2, I would like to bulk export a large table's data
> via the TableOperations::exportTable method. When I start copying the
> rfiles in distcp.txt is there any guarantee those rfiles will exist (as
> long as the cloned/offlined table exists)? I'm wondering if a system
> initiated major compaction might cause certain files to no longer be found.
>
> Thank you,
>
> Tim
> CONFIDENTIALITY NOTICE: This e-mail is intended only for the person or
> entity to which it is addressed and may contain information that is
> privileged, confidential or otherwise protected from disclosure under
> applicable law. Any use, disclosure, distribution, or copying of this
> e-mail or the information contained herein by anyone other than the
> intended recipient is prohibited and may be a violation of state and/or
> Federal privacy laws. If you have received this e-mail in error, please
> delete any copies of it from your computer.
>

Re: Table Export Question

[Dave Marion <dm...@gmail.com>]

The garbage collector will not (should not) remove files for a table that
is cloned. Cloning a table, then offlining it for export I believe is the
recommended pattern.

On Wed, Nov 20, 2024 at 4:58 PM Timothy Hong (US)
<ti...@ptech-llc.com.invalid> wrote:

> Hello,
>
> Using Accumulo 1.10.2, I would like to bulk export a large table's data
> via the TableOperations::exportTable method. When I start copying the
> rfiles in distcp.txt is there any guarantee those rfiles will exist (as
> long as the cloned/offlined table exists)? I'm wondering if a system
> initiated major compaction might cause certain files to no longer be found.
>
> Thank you,
>
> Tim
> CONFIDENTIALITY NOTICE: This e-mail is intended only for the person or
> entity to which it is addressed and may contain information that is
> privileged, confidential or otherwise protected from disclosure under
> applicable law. Any use, disclosure, distribution, or copying of this
> e-mail or the information contained herein by anyone other than the
> intended recipient is prohibited and may be a violation of state and/or
> Federal privacy laws. If you have received this e-mail in error, please
> delete any copies of it from your computer.
>