You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "HelloWorldwangjiacheng (via GitHub)" <gi...@apache.org> on 2024/11/14 07:44:58 UTC
[I] iceberg docker-compose quickstart fail [iceberg]
HelloWorldwangjiacheng opened a new issue, #11544:
URL: https://github.com/apache/iceberg/issues/11544
### Apache Iceberg version
1.5.0
### Query engine
Spark
### Please describe the bug 🐞
Background: I just want to make a quick-start spark-iceberg under docker-compose to experiment with data lake related functions
My Steps:
1、Obtain the docker-compose.yml code
Due to the occupation of ports 8888 and 8080, 28888 and 28080 were used instead.
2、Then execute docker-compose up -d to start it.
3、Then execute docker-compose ps, but there is no content related to "rest" displayed here. I'm not sure if this is normal.
4、Execute docker compose exec -it spark-iceberg pyspark to enter PySpark.
Here, I executed the statement df.select(df.columns[:7]).show(3) with the intention of querying the first seven columns of the first three rows of data, but unfortunately, an error occurred.
5、Error Content: The ultimate cause of the error seems to be that the hostname for "rest" is not configured, or possibly other containers are unable to read it.
6、I seem to have seen this kind of error in past issues, but it was related to version 0.1.0 of "rest" and was reported in 2022. Moreover, that issue was closed at the time, suggesting that it had been resolved. However, it seems to have appeared again now? Or could it be that I haven't configured something correctly? url:https://github.com/apache/iceberg/issues/5993
### Willingness to contribute
- [ ] I can contribute a fix for this bug independently
- [ ] I would be willing to contribute a fix for this bug with guidance from the Iceberg community
- [X] I cannot contribute a fix for this bug at this time
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] iceberg docker-compose quickstart fail [iceberg]
Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra commented on issue #11544:
URL: https://github.com/apache/iceberg/issues/11544#issuecomment-2475960661
@HelloWorldwangjiacheng this means that your `iceberg-rest` container isn't running. Maybe try running docker compose in the foreground via `docker compose up` to see why `iceberg-rest` isn't starting. Also try pulling the latest images via `docker compose pull`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] iceberg docker-compose quickstart fail [iceberg]
Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra commented on issue #11544:
URL: https://github.com/apache/iceberg/issues/11544#issuecomment-2482143545
It might be because docker is limiting how much memory that container gets. Maybe try running the `iceberg-rest` container in isolation first. Typically it shouldn't need a lot of memory. I'll go ahead and close this issue, since there isn't really an issue with Iceberg itself.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] iceberg docker-compose quickstart fail [iceberg]
Posted by "nastra (via GitHub)" <gi...@apache.org>.
nastra closed issue #11544: iceberg docker-compose quickstart fail
URL: https://github.com/apache/iceberg/issues/11544
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] iceberg docker-compose quickstart fail [iceberg]
Posted by "HelloWorldwangjiacheng (via GitHub)" <gi...@apache.org>.
HelloWorldwangjiacheng commented on issue #11544:
URL: https://github.com/apache/iceberg/issues/11544#issuecomment-2481742088
Hello friend, you are right. I did find an error in iceberg-rest when starting the front-end through docker-compose up, but I am now confused and don't know how to solve it. Because the literal meaning seems to be that I have insufficient memory, so I have reserved enough memory and increased the startup size of the JVM to xms512M Xmx1024M, but when I restart, I still get the same error
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org