You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@openserverless.apache.org by "mobs75 (via GitHub)" <gi...@apache.org> on 2025/11/22 16:10:48 UTC

[PR] feat: Add Apache Spark operator implementation [openserverless-operator]

mobs75 opened a new pull request, #77:
URL: https://github.com/apache/openserverless-operator/pull/77

   ## Summary
   
   Complete Apache Spark operator implementation for OpenServerless.
   
   ## Changes
   
   ### New Files
   - `nuvolaris/spark.py`: Core Spark operator module (create/delete/patch)
   - `nuvolaris/templates/spark-*`: Kubernetes manifests (Master, History Server, RBAC)
   - `deploy/spark/`: Deployment resources
   
   ### Modified Files
   - `nuvolaris/patcher.py`: Added Spark patching logic
   - `nuvolaris/main.py`: Integrated Spark into operator workflow
   
   ## Key Features
   - ✅ Spark Master StatefulSet with configurable resources
   - ✅ Spark History Server with MinIO S3 integration
   - ✅ Proper memory format conversion (K8s `1Gi` ↔ JVM `1g`)
   - ✅ RBAC with least-privilege access
   - ✅ Health checks and owner references
   
   ## Testing
   Verified on MicroK8s:
   ```bash
   kubectl get pods -l app=spark
   NAME                     READY   STATUS    RESTARTS   AGE
   spark-history-xxx        1/1     Running   0          10m
   spark-master-0           1/1     Running   0          10m
   ```
   
   Part of main integration PR: apache/openserverless#TBD


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@openserverless.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] feat: Add Apache Spark operator implementation [openserverless-operator]

Posted by "sciabarracom (via GitHub)" <gi...@apache.org>.
sciabarracom commented on PR #77:
URL: https://github.com/apache/openserverless-operator/pull/77#issuecomment-4030003622

   not for now


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@openserverless.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] feat: Add Apache Spark operator implementation [openserverless-operator]

Posted by "sciabarracom (via GitHub)" <gi...@apache.org>.
sciabarracom closed pull request #77: feat: Add Apache Spark operator implementation
URL: https://github.com/apache/openserverless-operator/pull/77


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@openserverless.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org