[GitHub] [incubator-mxnet] tianylijun removed a comment on issue #15432: [quantization] is there any plan to support 6bits quantization , as 6 bits quantization more efficient than 8 bits on arm cpu

[GitBox <gi...@apache.org>]

tianylijun removed a comment on issue #15432: [quantization] is there any plan to support 6bits quantization , as 6 bits quantization more efficient than 8 bits on arm cpu
URL: https://github.com/apache/incubator-mxnet/issues/15432#issuecomment-507721651
 
 
   As current ARM SIMD do not support int32 += int8*int8（except Cotex A55，A75)，unfortunate 8bits MAC will overflow during 4X4 sgemm block(127*127*4 exceed int16 range )，so int8 need first convert to int16 then do int32 += int16*int16. but 6 bits will not overflow in 4x4 sgemm block，so 6 bits can use directly use int16+= int8*int8 MAC，more efficient than 8 bits

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services