[GitHub] [arrow] yaqi-zhao opened a new issue, #14684: Parquet REL decoding w/IAA(Intel® In-Memory Analytics Accelerator)

[GitBox <gi...@apache.org>]

yaqi-zhao opened a new issue, #14684:
URL: https://github.com/apache/arrow/issues/14684

   We want to add new codes to enable a new RLE Decoding path by using Intel® In-Memory Analytics Accelerator (Intel® IAA).  The new solution provides in general higher performance than the current solution, and also consumes less CPU.
   
   Intel® In-Memory Analytics Accelerator (Intel® IAA) is a hardware accelerator available in the upcoming generation of Intel® Xeon® Scalable processors ("Sapphire Rapids"). Its goal is to speed up common operations in analytics like data (de)compression and filtering. 
   
   We are concerned about 3 issues:
   1.	Since IAA is a new accelerator in next-generation processors which will be published soon,  the current machine running CI cannot support this feature. I don’t know if it is acceptable that we run the CI offline, maybe on Intel’s lab environment. 
   2.	 [Intel® Query Processing Library (QPL)](https://github.com/intel/qpl) is a library to access the hardware accelerator IAA, is it acceptable to added the dependency in the tool chain?
   3.  Do you think the work is valuable?
   
   
   Thank you!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org