[GitHub] [hadoop] ajayydv commented on issue #746: HDDS-1442. add spark container to ozonesecure-mr compose files. Contributed by Ajay Kumar.

[GitBox <gi...@apache.org>]

ajayydv commented on issue #746: HDDS-1442. add spark container to ozonesecure-mr compose files. Contributed by Ajay Kumar.
URL: https://github.com/apache/hadoop/pull/746#issuecomment-484200110
 
 
   > Looks good to me but not clear what is the ahadoop/spark:v1 and how is it maintained.
   > 
   > 1. Where it the source of this image and how can we create PRs? (If you have a simple repo and automated build can be better...)
   > 2. Which version of spark is included in the image (v1 tag is not very clear)
   > 3. The entrypoint of the dockerimage doesn't allow to start the container easily (docker run ahadoop/spark:v1 bash --> instead of bash the download is started)
   Its modified version of our hadoop docker runner. Source is currently in my private repo (https://github.com/ajayydv/docker/tree/spark) but we can push it to public git. Don't think hadoop repo is right place for this as this has mostly spark bits. this uses spark 2.4.3 but it can be overrided via config (SPARK_DOWNLOAD_URL).

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org