[GitHub] skonto commented on issue #22608: [SPARK-25750][K8S][TESTS] Kerberos Support Integration Tests

[GitBox <gi...@apache.org>]

skonto commented on issue #22608: [SPARK-25750][K8S][TESTS] Kerberos Support Integration Tests
URL: https://github.com/apache/spark/pull/22608#issuecomment-460601636
 
 
   @mccheah it is possible to use multiple processes per container for testing: https://cloud.google.com/solutions/best-practices-for-building-containers (several vendors do).
   Yet it is much cleaner to fail at the container level when debugging stuff so I also think a pod is a better choice (it will be as if we are running all hdfs stuff on the same host). Kdc also should be on its own, at least this is how we tested this with integration tests in the past on mesos and it was much cleaner again.
   There is an option to use hadoop images: https://hadoop.apache.org/docs/r2.7.3/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html so in the future it might be better to integrate with kerberos there if people want to test with a specific hadoop version (not sure if version matters). 
   
   
    

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org