[GitHub] [beam] kennknowles opened a new issue, #18701: Fully specify the length prefix coder

[GitBox <gi...@apache.org>]

kennknowles opened a new issue, #18701:
URL: https://github.com/apache/beam/issues/18701

   Choose a variable integer encoding that is efficient in encoding/decoding speed out of one of the many variants like LEB128 / PrefixVarint / SQLite varint
   
   Also update the length prefix encoding to be parameterized by a block size so that the entire object doesn't have to be written in memory as per [http://doc/1IGduUqmhWDi_69l9nG8kw73HZ5WI5wOps9Tshl5wpQA/edit#heading=h.j8zpiclux4id](http://doc/1IGduUqmhWDi_69l9nG8kw73HZ5WI5wOps9Tshl5wpQA/edit#heading=h.j8zpiclux4id)
   
   Add cross language validation tests for encoding/decoding to [https://github.com/apache/beam/blob/master/sdks/python/apache_beam/testing/data/standard_coders.yaml](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/testing/data/standard_coders.yaml)
   
   Document the format explicitly and choose a stable URN.
   
   Imported from Jira [BEAM-3401](https://issues.apache.org/jira/browse/BEAM-3401). Original Jira may contain additional context.
   Reported by: lcwik.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org