You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2021/06/04 10:21:15 UTC

[GitHub] [iceberg] kbendick commented on pull request #2674: Clarify preconditions in spark 2 TestCatalog initialization

kbendick commented on pull request #2674:
URL: https://github.com/apache/iceberg/pull/2674#issuecomment-854582461


   > for what its worth we have:
   > 
   > * A [Demo notebook](https://colab.research.google.com/github/projectnessie/nessie-demos/blob/main/colab/nessie-iceberg-demo-nba.ipynb) which sets up Nessie, Spark etc and runs some basic iceberg commands
   > * A [Spark Config notebook](https://colab.research.google.com/github/projectnessie/nessie-demos/blob/main/colab/nessie-iceberg-spark-setup.ipynb) to hihglight the important configs for spark when running iceberg
   > * a [docker-compose.yaml](https://github.com/projectnessie/nessie/blob/main/python/demo/docker-compose.yml) specifically for iceberg/spark.
   > 
   > Given the nessie specifics it might not be exactly right for you but hopefully there are some bits that could be reusable. We also did all of our demos/examples in python so that they could run on colab w/o extra infrastructure
   
   Cool. That will likely complement well with what I have, though it might need some tweaking. I'm opening a ticket now, but I will try to get my stuff up early next week for review and then we can iterate from there? We don't necessarily have to use my setup even, but it's probably the lowest common denominator while still being fully featured. The one big thing it's missing currently is a notebook server, which I was going to add, but in the interest of getting it up for discussion and community review, I'll just go with the basics. cc'ing you and the folks you mentioned on the ticket now! 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org