[GitHub] [couchdb] fangq commented on issue #2203: Add support for MessagePack, or other compact/binary format

[GitBox <gi...@apache.org>]

fangq commented on issue #2203:
URL: https://github.com/apache/couchdb/issues/2203#issuecomment-699381248


   I am interested in developing couchdb/nosql databases for storing hierarchical scientific data - for example, imaging data of different binary types, dimensions, with/without compression - I've developed specifications to enable JSON to encode common scientific data structures (http://openjdata.org/, https://github.com/fangq/jdata/blob/master/JData_specification.md#data-annotation-keywords), but to support binary strongly-typed data, I need to use base64 with JSON, which increases the data file size by ~33%.
   
   To mitigate this, I extended the UBJSON spec (https://ubjson.org/) to support binary data types, see Binary JData (BJData) spec
   
   https://github.com/fangq/bjdata/blob/master/Binary_JData_Specification.md#type_summary
   
   BJData is similar MessagePack/CBOR, but much simpler to encode/decode, and is also quasi-human-readable, despite being a binary format. I will be very happy to contribute if there is an interest to support BJData/UBJSON in CouchDB. I currently have a [MATLAB ](https://github.com/fangq/jsonlab)and a Python parser/writer (https://github.com/fangq/pybj, based on py-ubjson, includes both native python code and c-code).
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org