You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Andrew Harrison <an...@returnpath.net> on 2011/03/10 21:51:38 UTC
WARN logs using embedded Hive JDBC on CDH3B4
We're upgrading our Hadoop cluster (including Hive) to CDH3B4 on our dev cluster. After doing so, we see some concerning WARN logs, when connecting via the embedded hive JDBC connector. It doesn't seem to cause any obvious ill-effects, but I thought I'd post to this list to see if anyone had any insight.
-Andrew Harrison
Logs:
2011-03-10 10:36:01 [ main] INFO DataNucleus.Persistence - ===========================================================
2011-03-10 10:36:02 [ main] INFO DataNucleus.Datastore.Schema - Initialising Catalog "", Schema "" using "None" auto-start option
2011-03-10 10:36:02 [ main] INFO DataNucleus.Datastore.Schema - Catalog "", Schema "" initialised - managing 0 classes [FIXED]
2011-03-10 10:36:02 [ main] INFO oop.hive.metastore.ObjectStore - Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo, Partition,Database,Type,FieldSchema,Order"
2011-03-10 10:36:02 [ main] INFO DataNucleus.MetaData - Registering listener for metadata initialisation
2011-03-10 10:36:02 [ main] INFO oop.hive.metastore.ObjectStore - Initialized ObjectStore
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 11, column 6 : cvc-elt.1: Cannot find the declaration of element 'jdo'. - Please check your specification of DTD and the validity of the MetaData XML that y ou have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 312, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 359, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 381, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 416, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 453, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 494, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 535, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 576, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 621, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 666, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] INFO DataNucleus.Persistence - Managing Persistence of Class : org.apache.hadoop.hive.metastore.model.MDatabase [Table : `DBS`, InheritanceSt rategy : new-table]
2011-03-10 10:36:03 [ main] INFO DataNucleus.Persistence - Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MDatabase.parameters [Table : `DATABASE _PARAMS`]
2011-03-10 10:36:03 [ main] INFO DataNucleus.MetaData - Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MDatabase
Hive history file=/tmp/aharrison/hive_job_log_aharrison_201103101036_1220815779.txt
Re: WARN logs using embedded Hive JDBC on CDH3B4
Posted by Carl Steinbach <ca...@cloudera.com>.
Hi Andrew,
You can safely ignore these warnings. Datanucleus is complaining because the
metastore mapping file fails to validate against the JDO DTD, apparently
because we failed to put the elements in a certain specific order. As far as
I can tell Datanucleus ignores the validation errors, so this shouldn't be
an issue.
Thanks.
Carl
On Thu, Mar 10, 2011 at 12:51 PM, Andrew Harrison <
andrew.harrison@returnpath.net> wrote:
> We’re upgrading our Hadoop cluster (including Hive) to CDH3B4 on our dev
> cluster. After doing so, we see some concerning WARN logs, when connecting
> via the embedded hive JDBC connector. It doesn’t seem to cause any obvious
> ill-effects, but I thought I’d post to this list to see if anyone had any
> insight.
>
>
>
> -Andrew Harrison
>
>
>
> Logs:
>
>
>
> 2011-03-10 10:36:01 [ main] INFO DataNucleus.Persistence
> - ===========================================================
>
> 2011-03-10 10:36:02 [ main] INFO DataNucleus.Datastore.Schema
> - Initialising Catalog "", Schema "" using "None" auto-start option
>
> 2011-03-10 10:36:02 [ main] INFO DataNucleus.Datastore.Schema
> - Catalog "", Schema "" initialised - managing 0 classes [FIXED]
>
> 2011-03-10 10:36:02 [ main] INFO oop.hive.metastore.ObjectStore
> - Setting MetaStore object pin classes with
> hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,
> Partition,Database,Type,FieldSchema,Order"
>
> 2011-03-10 10:36:02 [ main] INFO DataNucleus.MetaData
> - Registering listener for metadata initialisation
>
> 2011-03-10 10:36:02 [ main] INFO oop.hive.metastore.ObjectStore
> - Initialized ObjectStore
>
> 2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
> - MetaData Parser encountered an error in file
> "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
> DH3B4.jar!/package.jdo" at line 11, column 6 : cvc-elt.1: Cannot find the
> declaration of element 'jdo'. - Please check your specification of DTD and
> the validity of the MetaData XML that y ou have specified.
>
> 2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
> - MetaData Parser encountered an error in file
> "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
> DH3B4.jar!/package.jdo" at line 312, column 13 : The content of element type
> "class" must match
> "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
> n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
> - Please check your specification of DTD and the validity of the MetaData
> XML that you have specified.
>
> 2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
> - MetaData Parser encountered an error in file
> "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
> DH3B4.jar!/package.jdo" at line 359, column 13 : The content of element type
> "class" must match
> "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
> n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
> - Please check your specification of DTD and the validity of the MetaData
> XML that you have specified.
>
> 2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
> - MetaData Parser encountered an error in file
> "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
> DH3B4.jar!/package.jdo" at line 381, column 13 : The content of element type
> "class" must match
> "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
> n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
> - Please check your specification of DTD and the validity of the MetaData
> XML that you have specified.
>
> 2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
> - MetaData Parser encountered an error in file
> "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
> DH3B4.jar!/package.jdo" at line 416, column 13 : The content of element type
> "class" must match
> "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
> n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
> - Please check your specification of DTD and the validity of the MetaData
> XML that you have specified.
>
> 2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
> - MetaData Parser encountered an error in file
> "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
> DH3B4.jar!/package.jdo" at line 453, column 13 : The content of element type
> "class" must match
> "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
> n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
> - Please check your specification of DTD and the validity of the MetaData
> XML that you have specified.
>
> 2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
> - MetaData Parser encountered an error in file
> "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
> DH3B4.jar!/package.jdo" at line 494, column 13 : The content of element type
> "class" must match
> "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
> n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
> - Please check your specification of DTD and the validity of the MetaData
> XML that you have specified.
>
> 2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
> - MetaData Parser encountered an error in file
> "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
> DH3B4.jar!/package.jdo" at line 535, column 13 : The content of element type
> "class" must match
> "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
> n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
> - Please check your specification of DTD and the validity of the MetaData
> XML that you have specified.
>
> 2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
> - MetaData Parser encountered an error in file
> "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
> DH3B4.jar!/package.jdo" at line 576, column 13 : The content of element type
> "class" must match
> "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
> n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
> - Please check your specification of DTD and the validity of the MetaData
> XML that you have specified.
>
> 2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
> - MetaData Parser encountered an error in file
> "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
> DH3B4.jar!/package.jdo" at line 621, column 13 : The content of element type
> "class" must match
> "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
> n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
> - Please check your specification of DTD and the validity of the MetaData
> XML that you have specified.
>
> 2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
> - MetaData Parser encountered an error in file
> "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
> DH3B4.jar!/package.jdo" at line 666, column 13 : The content of element type
> "class" must match
> "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
> n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
> - Please check your specification of DTD and the validity of the MetaData
> XML that you have specified.
>
> 2011-03-10 10:36:03 [ main] INFO DataNucleus.Persistence
> - Managing Persistence of Class :
> org.apache.hadoop.hive.metastore.model.MDatabase [Table : `DBS`,
> InheritanceSt rategy : new-table]
>
> 2011-03-10 10:36:03 [ main] INFO DataNucleus.Persistence
> - Managing Persistence of Field :
> org.apache.hadoop.hive.metastore.model.MDatabase.parameters [Table :
> `DATABASE _PARAMS`]
>
> 2011-03-10 10:36:03 [ main] INFO DataNucleus.MetaData
> - Listener found initialisation for persistable class
> org.apache.hadoop.hive.metastore.model.MDatabase
>
> Hive history
> file=/tmp/aharrison/hive_job_log_aharrison_201103101036_1220815779.txt
>