You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Jan Rasehorn <j....@gmail.com> on 2017/01/27 14:51:59 UTC
Another instance of Derby already booted the database .../metastore_db
Hello,
I was running into an issue with a query on a temp table and to test it I
opened another notebook in another tab. When I execute this new notebook, I
got an error:
Caused by: java.sql.SQLException: Failed to start database 'metastore_db'
with class loader
org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@1ec187c, see
the next exception for details.
at
org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown
Source)
at
org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown
Source)
... 132 more
Caused by: java.sql.SQLException: Another instance of Derby may have
already booted the database /opt/zeppelin-0.6.2/bin/metastore_db
I'm running Spark in isolated mode.
Does anybody know how to fix that?
Re: Another instance of Derby already booted the database
.../metastore_db
Posted by Felix Cheung <fe...@hotmail.com>.
The issue is since you are running Spark interpreter in isolated mode there are two running Spark driver process trying to access derby metastore at the same location, at the same time.
There are some config in Spark that could redirect metastore to different location (try spark.warehouse.dir) but ideally you want to be able to share temp view and so on and would need to have a shared metastore. In such case it would be best to use the external Hive metastore server instead - making sure hive-site.xml is available would be the way to go.
_____________________________
From: Paul Brenner <pb...@placeiq.com>>
Sent: Friday, January 27, 2017 8:01 AM
Subject: Another instance of Derby already booted the database .../metastore_db
To: <us...@zeppelin.apache.org>>
We had this same problem. Copying or symlinking hive-site.xml to the zeppelin conf directory and then restarting solved it for us.
<http://www.placeiq.com/><http://www.placeiq.com/>[https://ci3.googleusercontent.com/proxy/tFn1I-GEOnccUtv8DHHEc49-6g3x3CbuQKzbfl2Z1BObEy0Qz6QebJimpP96TK3Za5MXwXTuwBZaobKp22nYAG3NdxAC0Q=s0-d-e1-ft#https://marketing.placeiq.net/images/placeiq.png]<http://www.placeiq.com/> Paul Brenner <https://twitter.com/placeiq> <https://twitter.com/placeiq> [https://ci4.googleusercontent.com/proxy/490PXYv9O6OiIp_DL4vuabJqVn53fMon5xNYZdftCVea9ySR2LcFDHe6Cdntb2G68uDAuA6FgLny8wKWLFWpsrPAt_FtLaE=s0-d-e1-ft#https://marketing.placeiq.net/images/twitter1.png] <https://twitter.com/placeiq> <https://www.facebook.com/PlaceIQ> [https://ci3.googleusercontent.com/proxy/fztHf1lRKLQYcAxebqfp2PYXCwVap3GobHVIbyp0j3NcuJOY16bUAZBibVOFf-fd1GsiuhrOfYy6dSwhlCwWU8ZUlw9OX5I=s0-d-e1-ft#https://marketing.placeiq.net/images/facebook.png] <https://www.facebook.com/PlaceIQ> <https://www.linkedin.com/company/placeiq> [https://ci5.googleusercontent.com/proxy/H26ThD7R6DOqxoLTgzi6k5SMrHoF2Tj44xI_7XlD9KfOIiGwe1WIMc5iQBxUBA9EuIyJMdaRXrhZTOrnkrn8O9Rf1FP9UQU=s0-d-e1-ft#https://marketing.placeiq.net/images/linkedin.png] <https://www.linkedin.com/company/placeiq>
DATA SCIENTIST
(217) 390-3033
<http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/><http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/><http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/><http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/><http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/><http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/><http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/><http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/><http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/><http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/><http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/><http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP><http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/><http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/>[PlaceIQ:Location Data Accuracy]<http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/>
On Fri, Jan 27, 2017 at 9:51 AM Jan Rasehorn <Jan Rasehorn<ma...@gmail.com>>> wrote:
Hello,
I was running into an issue with a query on a temp table and to test it I opened another notebook in another tab. When I execute this new notebook, I got an error:
Caused by: java.sql.SQLException: Failed to start database 'metastore_db' with class loader org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@1ec187c, see the next exception for details.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
... 132 more
Caused by: java.sql.SQLException: Another instance of Derby may have already booted the database /opt/zeppelin-0.6.2/bin/metastore_db
I'm running Spark in isolated mode.
Does anybody know how to fix that?
Another instance of Derby already booted the database
.../metastore_db
Posted by Paul Brenner <pb...@placeiq.com>.
We had this same problem. Copying or symlinking hive-site.xml to the zeppelin conf directory and then restarting solved it for us.
http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/
Paul Brenner
https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq
https://www.facebook.com/PlaceIQ https://www.facebook.com/PlaceIQ
https://www.linkedin.com/company/placeiq https://www.linkedin.com/company/placeiq
DATA SCIENTIST
(217) 390-3033
http://www.placeiq.com/2015/05/26/placeiq-named-winner-of-prestigious-2015-oracle-data-cloud-activate-award/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2015/12/18/accuracy-vs-precision-in-location-data-mma-webinar/ http://placeiq.com/2016/03/08/measuring-addressable-tv-campaigns-is-now-possible/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://placeiq.com/2016/04/13/placeiq-joins-the-network-advertising-initiative-nai-as-100th-member/ http://pages.placeiq.com/Location-Data-Accuracy-Whitepaper-Download.html?utm_source=Signature&utm_medium=Email&utm_campaign=AccuracyWP http://placeiq.com/2016/08/03/placeiq-bolsters-location-intelligence-platform-with-mastercard-insights/ http://placeiq.com/2016/10/26/the-making-of-a-location-data-industry-milestone/ http://placeiq.com/2016/12/07/placeiq-introduces-landmark-a-groundbreaking-offering-that-delivers-access-to-the-highest-quality-location-data-for-insights-that-fuel-limitless-business-decisions/
On Fri, Jan 27, 2017 at 9:51 AM Jan Rasehorn
<
mailto:Jan Rasehorn <j....@gmail.com>
> wrote:
a, pre, code, a:link, body { word-wrap: break-word !important; }
Hello,
I was running into an issue with a query on a temp table and to test it I opened another notebook in another tab. When I execute this new notebook, I got an error:
Caused by: java.sql.SQLException: Failed to start database 'metastore_db' with class loader org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@1ec187c, see the next exception for details.
at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
... 132 more
Caused by: java.sql.SQLException: Another instance of Derby may have already booted the database /opt/zeppelin-0.6.2/bin/metastore_db
I'm running Spark in isolated mode.
Does anybody know how to fix that?