You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/05/07 02:53:28 UTC
[GitHub] [incubator-doris] pan3793 opened a new issue, #9426: [Feature] Runtime docker image
pan3793 opened a new issue, #9426:
URL: https://github.com/apache/incubator-doris/issues/9426
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
### Description
I'm asking for a runtime Doris image, mostly for testing purpose.
Before requesting, I found a https://hub.docker.com/r/apachedoris/doris-dev by searching on GitHub, it's for dev not runtime.
### Use case
Mostly for testing purpose.
For example, the doris-spark-connector requires user setup doris locally before running test, it's not friendly, and can not be verified by CI.
https://github.com/apache/incubator-doris-spark-connector/blob/094d76f84d2761ff18dfbbe5118539ba5f5cd142/spark-doris-connector/src/test/scala/org/apache/doris/spark/sql/TestSparkConnector.scala#L25-L35
This is a integration testing demo of Spark ClickHouse connector, which leverage Testcontainers to run test with ClickHouse single node and cluster w/o user pre-setup ClickHouse but only have Docker and Docker Compose installed.
https://github.com/housepower/spark-clickhouse-connector/tree/master/clickhouse-core/src/testFixtures/scala/xenon/clickhouse/base
### Related issues
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Feature] Runtime docker image [doris]
Posted by "linghengqian (via GitHub)" <gi...@apache.org>.
linghengqian commented on issue #9426:
URL: https://github.com/apache/doris/issues/9426#issuecomment-2118825746
- After completing https://github.com/apache/shardingsphere/issues/31256 , I revisited the current issue but remained uncertain about the initial lack of progress on it. This seems to merely entail building Dockerfiles with multiple different download links for the same Docker image tag, from my perspective, involving three types of Dockerfiles: x64/linux, arm64/linux, and x64noavx2/linux, each separately constructing the FE and BE. Taking the Dockerfile for x64/linux as an example.
- For FE, it looks like this. (not verified) Use of https://apache-doris-releases.oss-accelerate.aliyuncs.com/ is from the Doris documentation in https://doris.apache.org/download/ .
```dockerfile
FROM openjdk:8u342-jdk
ENV JAVA_HOME="/usr/local/openjdk-8/"
ENV PATH="/opt/apache-doris/fe/bin:$PATH"
apt-get install -y wget
wget https://apache-doris-releases.oss-accelerate.aliyuncs.com/apache-doris-2.1.2-bin-x64.tar.gz -O /opt/apache-doris-bin.tar.gz
RUN apt-get update && \
apt-get install -y default-mysql-client && \
apt-get clean && \
mkdir /opt/apache-doris && \
cd /opt && \
mv apache-doris-bin/fe /opt/apache-doris/
wget https://raw.githubusercontent.com/apache/doris/2.1.2-rc04/docker/runtime/fe/resource/init_fe.sh -O /opt/apache-doris/fe/bin/init_fe.sh
RUN chmod 755 /opt/apache-doris/fe/bin/init_fe.sh
ENTRYPOINT ["/opt/apache-doris/fe/bin/init_fe.sh"]
```
- For BE, it looks like this. (not verified)
```dockerfile
FROM openjdk:8u342-jdk
ENV JAVA_HOME="/usr/local/openjdk-8/"
ENV PATH="/opt/apache-doris/be/bin:$PATH"
apt-get install -y wget
wget https://apache-doris-releases.oss-accelerate.aliyuncs.com/apache-doris-2.1.2-bin-x64.tar.gz -O /opt/apache-doris-bin.tar.gz
RUN apt-get update && \
apt-get install -y default-mysql-client && \
apt-get clean && \
mkdir /opt/apache-doris && \
cd /opt && \
mv apache-doris-bin/be /opt/apache-doris/
wget https://github.com/apache/doris/blob/2.1.2-rc04/docker/runtime/be/resource/init_be.sh -O /opt/apache-doris/be/bin/init_be.sh
RUN chmod 755 /opt/apache-doris/be/bin/init_be.sh
ENTRYPOINT ["/opt/apache-doris/be/bin/init_be.sh"]
```
- If there are no Runtime-level Docker Images available on Docker Hub or ghcr.io, integrating Doris for testing in other projects without pre-building the Docker Images would necessitate multiple downloads of binary files akin to `apache-doris-2.0.3-bin.tar.gz` under testcontainers-java's Java API using ImageFromDockerfile, thereby increasing the overhead during the test setup process. It's hard to say this is an intuitive way to go about it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Feature] Runtime docker image [doris]
Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman closed issue #9426: [Feature] Runtime docker image
URL: https://github.com/apache/doris/issues/9426
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] linghengqian commented on issue #9426: [Feature] Runtime docker image
Posted by GitBox <gi...@apache.org>.
linghengqian commented on issue #9426:
URL: https://github.com/apache/doris/issues/9426#issuecomment-1242764126
- What should the shape of the docker image look like? Should it be something like https://github.com/apache/incubator-kyuubi/issues/2577#issuecomment-1120228458 ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] myfjdthink commented on issue #9426: [Feature] Runtime docker image
Posted by GitBox <gi...@apache.org>.
myfjdthink commented on issue #9426:
URL: https://github.com/apache/doris/issues/9426#issuecomment-1184058174
After I tried, doris is running successfully in docker-compose, https://github.com/myfjdthink/doris-docker-compose hope it helps you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] qomosoloto commented on issue #9426: [Feature] Runtime docker image
Posted by "qomosoloto (via GitHub)" <gi...@apache.org>.
qomosoloto commented on issue #9426:
URL: https://github.com/apache/doris/issues/9426#issuecomment-1629139912
Any updation about this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org