You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by "avgAGB (via GitHub)" <gi...@apache.org> on 2023/03/30 11:49:50 UTC
[GitHub] [accumulo] avgAGB opened a new issue, #3267: Question on Differences between RFiles, 1.10.2 -> 2.1.1
avgAGB opened a new issue, #3267:
URL: https://github.com/apache/accumulo/issues/3267
I've noticed recently that Accumulo 2.0+ has backwards compatibility in terms of being able to import rfiles from 1.10.2 for example, but the opposite is understandably not the case. I was wondering, would anyone be able to explain what exactly is the difference between the way the rfiles are written or structured between the two versions, and is there any way for a 2.1.1 rfile to be converted backwards to something that 1.10.2 could import? Or are the versions mechanically too different to convert?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] ctubbsii closed issue #3267: Question on Differences between RFiles, 1.10.2 -> 2.1.1
Posted by "ctubbsii (via GitHub)" <gi...@apache.org>.
ctubbsii closed issue #3267: Question on Differences between RFiles, 1.10.2 -> 2.1.1
URL: https://github.com/apache/accumulo/issues/3267
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] avgAGB commented on issue #3267: Question on Differences between RFiles, 1.10.2 -> 2.1.1
Posted by "avgAGB (via GitHub)" <gi...@apache.org>.
avgAGB commented on issue #3267:
URL: https://github.com/apache/accumulo/issues/3267#issuecomment-1494508621
@ctubbsii One follow up question. It seems that when attempting to scan an rfile from a 2.1.1 using 1.10.4 jars I get an error involving an "Incompatible BCFile BCFileVersion" - would there be a way to scan or extract the information within a rfile with a newer BCFileVersion without tampering with the contents of the 2.1.1 rfile?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] ctubbsii commented on issue #3267: Question on Differences between RFiles, 1.10.2 -> 2.1.1
Posted by "ctubbsii (via GitHub)" <gi...@apache.org>.
ctubbsii commented on issue #3267:
URL: https://github.com/apache/accumulo/issues/3267#issuecomment-1492452534
@avgAGB We occasionally add features to RFiles that make it support things we add to Accumulo. Those changes won't be understood by older versions of Accumulo, but they don't typically alter the fundamental storage concepts of RFiles. I believe the main feature added after 1.10 was the ability to support data emitted from a configured Sampler.
If you need to extract data from one RFile version and store it in an older Accumulo version, you could just create a scanner and scan the data in the file, storing it in whatever intermediate format you wish.
Since this issue tracker is mainly used by developers to track issues, you may have luck finding home grown solutions for your situation, or similar situations, that you can adapt, from the bigger audience of users if you post your question to [the user mailing list](https://accumulo.apache.org/contact-us/).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] ctubbsii commented on issue #3267: Question on Differences between RFiles, 1.10.2 -> 2.1.1
Posted by "ctubbsii (via GitHub)" <gi...@apache.org>.
ctubbsii commented on issue #3267:
URL: https://github.com/apache/accumulo/issues/3267#issuecomment-1497887973
> @ctubbsii One follow up question. It seems that when attempting to scan an rfile from a 2.1.1 using 1.10.4 jars I get an error involving an "Incompatible BCFile BCFileVersion" - would there be a way to scan or extract the information within a rfile with a newer BCFileVersion without tampering with the contents of the 2.1.1 rfile?
You could use [the RFile client API](https://accumulo.apache.org/docs/2.x/apidocs/org/apache/accumulo/core/client/rfile/RFile.html#newScanner()) to read the contents.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org