Re: [I] Create binary releases [datafusion-comet]

["parthchandra (via GitHub)" <gi...@apache.org>]

parthchandra commented on issue #721:
URL: https://github.com/apache/datafusion-comet/issues/721#issuecomment-2316391612

   @andygrove @viirya I'm planning to work on this. Here's what I am proposing - 
   
   The process will follow the same workflow as we currently have with two additional steps - 
   
   1. Build an Uber jar with a select set of native binaries packaged in the  jar 
   2. Add a deployment management step in maven to deploy the built jars to Apache maven. 
   
   To build the uber jar  
   
   1. Create a comet-rm docker image (for comet release manager). The  comet-rm image will be based on Ubuntu 20.04 (TODO: confirm this) because the Spark 3.4 release docker image also uses this image. This base image supports amd64 and arm64v8 (arm64) architectures which we will use. The comet-rm image will package all the dependencies to build comet successfully. The entrypoint for this image will get comet from git and build a linux and macOs native binary for the architecture. 
   2. Create a build-release-binaries script. This will -
      1. Launch a docker container for both amd64 and arm64 architectures which will build the binaries for both linux and MacOs. We will end up with four native libs (in two containers).
      2. Copy the built binaries in the containers to the local build directories in the appropriate subdirectories
      3. Run maven package to build the jar locally.
    
   
   Deployment to maven  
     This will follow the steps outlined in the official guidance from Apache Infra https://infra.apache.org/publishing-maven-artifacts.html
     We do not plan to use the maven release plugin, but the rest of the guidance is valid. We simply need to add the deploymentManagement section in the pom file and document the steps for the release manager to set up their credentials.
     
    wdyt?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org