You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mahout.apache.org by "botszhuang (via GitHub)" <gi...@apache.org> on 2026/06/10 13:27:49 UTC

[I] [Proposal] Optimize phase_encode_kernel using LLVM JIT and CUDA Driver API for 5x+ Speedup [mahout]

botszhuang opened a new issue, #1394:
URL: https://github.com/apache/mahout/issues/1394

   ### What
   
   This proposal introduces a performance optimization for the phase_encode_kernel by leveraging LLVM with Just-In-Time (JIT) compilation and the CUDA Driver API. Initial assessments suggest this refactoring can yield a 5x+ speedup over the current implementation, significantly improving performance for workloads relying on this kernel.
   | Language | Kernel execution time |Gain|
   |:---|:---|:---|
   |CUDA C | 0.302787 ms | 1|
   |LLVM+JIT|0.0195 ms| ~ 15 |
   
   ### Why
   
   The goal of this optimization is to maximize hardware efficiency and properly utilize all available computing resources. Enhancing its execution speed via runtime compilation and direct hardware acceleration will dramatically reduce compute time and improve resource utilization across modern hardware backends.
   
   ### How
   
   - LLVM JIT Refactoring: Refactor the existing phase_encode_kernel function to generate LLVM Intermediate Representation (IR) dynamically, allowing for runtime optimization tailored to specific data shapes and parameters.
   
   - Execution Pipeline: Finalize the execution pipeline to smoothly bind the JIT-compiled LLVM kernel with the CUDA driver, including proper memory mapping.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@mahout.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Proposal] Optimize phase_encode_kernel using LLVM JIT and CUDA Driver API for 5x+ Speedup [mahout]

Posted by "botszhuang (via GitHub)" <gi...@apache.org>.
botszhuang closed issue #1394: [Proposal] Optimize phase_encode_kernel using LLVM JIT and CUDA Driver API for 5x+ Speedup
URL: https://github.com/apache/mahout/issues/1394


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@mahout.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org