You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Mich Talebzadeh <mi...@gmail.com> on 2021/08/14 06:46:52 UTC
Creating docker images for Data Science
Hi all,
I am intending to create a docker image with Python 3.1.1 and Java 8 to
include Python libraries for Data Science. Other versions with Java 11
will come later. The build process is automated with specific dockerfiles
for different purposes.
I am intending to install the following packages as first cut. The aim is
to eventually release these docker images as part of spark docker and
Kubernetes offerings. The medium to be released whether it be Spark
download site or other docker image maintainers to be decided and agreed.
Anyway these are the packages I am proposing to add for now:
1. PyTorch
2. Caffe
3. TensorFlow
4. Theano
5. Pandas
6. Keras
7. NumPy
8. SciPy
9. Scrapy
10. SciKit-Learn
11. XGBoost
12. Matplotlib
13. Seaborn
14. Bokeh
15. Plotly
16. pydot
17. Statsmodels
Please suggest if you want another package to be added.
Regards,
Mich
view my Linkedin profile
<https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.