You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by Alexander Zarei <al...@gmail.com> on 2015/05/01 00:24:37 UTC

Re: [VOTE] Release Apache Drill 0.9.0 (rc1)

Hi,

I downloaded a new MapR sandbox;
Stopped the default Drillbit;
Built form source and changed the zookeeper port from the default 2181 to
5181 like the default drillbit.

The new Drillbit does not start and throws the following error:



log4j:WARN No appenders could be found for logger
(com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
more info.
Exception in thread "main"
org.apache.drill.exec.exception.DrillbitStartupException: Failure while
initializing values in Drillbit.
        at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:80)
        at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
        at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
Caused by: org.apache.drill.common.exceptions.ExecutionSetupException: A
System Table provider was either not specified or could not be found or
instantiated
        at
org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:60)
        at org.apache.drill.exec.server.Drillbit.<init>(Drillbit.java:198)
        at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:78)
        ... 2 more
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
        at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at
org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:56)
        ... 4 more
Caused by: org.apache.drill.exec.exception.DrillbitStartupException:
Failure while attempting to set up blob store.
        at
org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:65)
        ... 9 more
Caused by: java.io.IOException: failure to login: No LoginModules
configured for hadoop_simple
        at
org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:654)
        at
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:606)
        at
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:519)
        at
org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2590)
        at
org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2582)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2448)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:404)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
        at
org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:103)
        at
org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:99)
        at
org.apache.drill.exec.store.sys.local.FilePStore.getFileSystem(FilePStore.java:85)
        at
org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:63)
        ... 9 more
Caused by: javax.security.auth.login.LoginException: No LoginModules
configured for hadoop_simple
        at
javax.security.auth.login.LoginContext.init(LoginContext.java:272)
        at
javax.security.auth.login.LoginContext.<init>(LoginContext.java:389)
        at
org.apache.hadoop.security.UserGroupInformation.newLoginContext(UserGroupInformation.java:408)
        at
org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:626)
        ... 20 more


I wonder if I need to change any configuration?

Thanks,
Alex


On Thu, Apr 30, 2015 at 2:17 PM, Steven Phillips <sp...@maprtech.com>
wrote:

> I just committed another fix, and I also included an option to revert to
> the old assignment code, in case further issues are found.
>
> On Thu, Apr 30, 2015 at 1:23 PM, Jacques Nadeau <ja...@apache.org>
> wrote:
>
> > I just ran across another instance of DRILL-2916.  That sinks this
> release
> > candidate.  Steven, can you take another look?
> >
> >
> >
> > On Thu, Apr 30, 2015 at 12:42 PM, Ted Dunning <te...@gmail.com>
> > wrote:
> >
> > >
> > > Somebody needs to check signatures an checksums.  Also the NOTICE and
> > > LICENSE files.
> > >
> > > Repeating the tests others have done has some value but actually
> walking
> > > through the tutorial or intro documentation step by step has the virtue
> > of
> > > breaking new ground.
> > >
> > > Sent from my iPhone
> > >
> > > > On Apr 30, 2015, at 11:31, Norris Lee <no...@simba.com> wrote:
> > > >
> > > > +1 (non-binding)
> > > >
> > > > Downloaded source and built on Linux. Ran Hive, HBase, DFS queries
> > > through ODBC.
> > > >
> > > > Norris
> > > >
> > > > -----Original Message-----
> > > > From: Jacques Nadeau [mailto:jacques@apache.org]
> > > > Sent: Wednesday, April 29, 2015 10:47 PM
> > > > Cc: dev@drill.apache.org
> > > > Subject: Re: [VOTE] Release Apache Drill 0.9.0 (rc1)
> > > >
> > > > Just to clarify, this incorporates a critical bug *FIX* found in rc0.
> > > >
> > > > :)
> > > >
> > > >> On Wed, Apr 29, 2015 at 10:14 PM, Jacques Nadeau <
> jacques@apache.org>
> > > wrote:
> > > >>
> > > >> Good evening,
> > > >>
> > > >> I would like to propose the release of Apache Drill, version 0.9.0.
> > > >> This is the second release candidate (rc1) and incorporates a
> critical
> > > >> bug found in rc0 (DRILL-2916).
> > > >>
> > > >> This release includes 200 resolved JIRAs [1].
> > > >>
> > > >> The artifacts are hosted at [2].
> > > >>
> > > >> The vote will be open for ~72 hours, ending 22:00 Pacific, May 2,
> 2015
> > > >>
> > > >> [ ] +1
> > > >> [ ] +0
> > > >> [ ] -1
> > > >>
> > > >>
> > > >> Thank you,
> > > >> Jacques
> > > >>
> > > >> [1]
> > > >>
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=1232881
> > > >> 3&projectId=12313820 [2]
> > > >> http://people.apache.org/~jacques/apache-drill-0.9.0.rc1/
> > > >>
> > >
> >
>
>
>
> --
>  Steven Phillips
>  Software Engineer
>
>  mapr.com
>

Re: [VOTE] Release Apache Drill 0.9.0 (rc1)

Posted by Alexander Zarei <al...@gmail.com>.
Thanks very much Venki! Your suggestion resolved the issue and worked
successfully.

Thanks,
Alex


On Thu, Apr 30, 2015 at 4:02 PM, Venki Korukanti <ve...@gmail.com>
wrote:

> It looks like your existing storage plugin config has MapRDB as one of the
> supported format plugin, but it can't find the implementation in your
> current Drill installation. The .tar.gz file you got/built from apache.org
> doesn't have the MapRDB plugin.
>
> Two options:
> 1. Either remove the plugin info from storage conf (may need to modify the
> files manually) or
> 2. Get the jar from your previous installation (look under jars folder -
> assuming your prev installation is from a rpm/deb downloaded from mapr.com
> )
> (I prefer this option)
>
> Thanks
> Venki
>
> On Thu, Apr 30, 2015 at 3:50 PM, Alexander Zarei <
> alexanderz.simba@gmail.com
> > wrote:
>
> > Thanks Venki. I did and it went ahead one more step but now it cannot
> > figure out the maprdb type; Marked below in bold.
> >
> > I googled it but not much relevant information was found. I wonder if you
> > could suggest a direction to look into it.
> >
> > log4j:WARN No appenders could be found for logger
> > (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
> > log4j:WARN Please initialize the log4j system properly.
> > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> > more info.
> > Exception in thread "main"
> > org.apache.drill.exec.exception.DrillbitStartupException: Failure during
> > initial startup of Drillbit.
> >         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:87)
> >         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
> >         at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
> > *Caused by: java.lang.RuntimeException:
> > com.fasterxml.jackson.databind.JsonMappingException: Could not resolve
> type
> > id 'maprdb' into a subtype of [simple type, class
> > org.apache.drill.common.logical.FormatPluginConfig]*
> >  at [Source: [B@927297a; line: 55, column: 7] (through reference chain:
> >
> >
> org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
> >         at
> >
> >
> org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:197)
> >         at
> >
> >
> org.apache.drill.exec.store.StoragePluginRegistry.createPlugins(StoragePluginRegistry.java:168)
> >         at
> >
> >
> org.apache.drill.exec.store.StoragePluginRegistry.init(StoragePluginRegistry.java:132)
> >         at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:244)
> >         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:84)
> >         ... 2 more
> > Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could not
> > resolve type id 'maprdb' into a subtype of [simple type, class
> > org.apache.drill.common.logical.FormatPluginConfig]
> >  at [Source: [B@927297a; line: 55, column: 7] (through reference chain:
> >
> >
> org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
> >         at
> >
> >
> com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148)
> >         at
> >
> >
> com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:849)
> >         at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:167)
> >         at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:99)
> >         at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:453)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:311)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:538)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:106)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:238)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:151)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:126)
> >         at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
> >         at
> >
> >
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132)
> >         at
> >
> >
> com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41)
> >         at
> >
> >
> com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1269)
> >         at
> >
> >
> com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:912)
> >         at
> >
> >
> org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
> >         at
> >
> >
> org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:195)
> >
> > Thanks,
> > Alex
> >
> >
> > On Thu, Apr 30, 2015 at 3:29 PM, Venki Korukanti <
> > venki.korukanti@gmail.com>
> > wrote:
> >
> > > MapR specific FileSystem implementation the requires following in JVM
> > > options:
> > >
> > > export DRILLBIT_JAVA_OPTS="$DRILLBIT_JAVA_OPTS
> > > -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf
> > > -Dzookeeper.sasl.client=false "
> > >
> > > (You can put this in conf/drill-env.sh)
> > >
> > > Thanks
> > > Venki
> > >
> > > On Thu, Apr 30, 2015 at 3:24 PM, Alexander Zarei <
> > > alexanderz.simba@gmail.com
> > > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I downloaded a new MapR sandbox;
> > > > Stopped the default Drillbit;
> > > > Built form source and changed the zookeeper port from the default
> 2181
> > to
> > > > 5181 like the default drillbit.
> > > >
> > > > The new Drillbit does not start and throws the following error:
> > > >
> > > >
> > > >
> > > > log4j:WARN No appenders could be found for logger
> > > > (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
> > > > log4j:WARN Please initialize the log4j system properly.
> > > > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
> > for
> > > > more info.
> > > > Exception in thread "main"
> > > > org.apache.drill.exec.exception.DrillbitStartupException: Failure
> while
> > > > initializing values in Drillbit.
> > > >         at
> > org.apache.drill.exec.server.Drillbit.start(Drillbit.java:80)
> > > >         at
> > org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
> > > >         at
> > org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
> > > > Caused by:
> org.apache.drill.common.exceptions.ExecutionSetupException:
> > A
> > > > System Table provider was either not specified or could not be found
> or
> > > > instantiated
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:60)
> > > >         at
> > > org.apache.drill.exec.server.Drillbit.<init>(Drillbit.java:198)
> > > >         at
> > org.apache.drill.exec.server.Drillbit.start(Drillbit.java:78)
> > > >         ... 2 more
> > > > Caused by: java.lang.reflect.InvocationTargetException
> > > >         at
> > sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > > > Method)
> > > >         at
> > > >
> > > >
> > >
> >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > > >         at
> > > >
> > > >
> > >
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > > >         at
> > > java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:56)
> > > >         ... 4 more
> > > > Caused by: org.apache.drill.exec.exception.DrillbitStartupException:
> > > > Failure while attempting to set up blob store.
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:65)
> > > >         ... 9 more
> > > > Caused by: java.io.IOException: failure to login: No LoginModules
> > > > configured for hadoop_simple
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:654)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:606)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:519)
> > > >         at
> > > >
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2590)
> > > >         at
> > > >
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2582)
> > > >         at
> > > org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2448)
> > > >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:404)
> > > >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:103)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:99)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.sys.local.FilePStore.getFileSystem(FilePStore.java:85)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:63)
> > > >         ... 9 more
> > > > Caused by: javax.security.auth.login.LoginException: No LoginModules
> > > > configured for hadoop_simple
> > > >         at
> > > > javax.security.auth.login.LoginContext.init(LoginContext.java:272)
> > > >         at
> > > > javax.security.auth.login.LoginContext.<init>(LoginContext.java:389)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.newLoginContext(UserGroupInformation.java:408)
> > > >         at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:626)
> > > >         ... 20 more
> > > >
> > > >
> > > > I wonder if I need to change any configuration?
> > > >
> > > > Thanks,
> > > > Alex
> > > >
> > > >
> > > > On Thu, Apr 30, 2015 at 2:17 PM, Steven Phillips <
> > sphillips@maprtech.com
> > > >
> > > > wrote:
> > > >
> > > > > I just committed another fix, and I also included an option to
> revert
> > > to
> > > > > the old assignment code, in case further issues are found.
> > > > >
> > > > > On Thu, Apr 30, 2015 at 1:23 PM, Jacques Nadeau <
> jacques@apache.org>
> > > > > wrote:
> > > > >
> > > > > > I just ran across another instance of DRILL-2916.  That sinks
> this
> > > > > release
> > > > > > candidate.  Steven, can you take another look?
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Thu, Apr 30, 2015 at 12:42 PM, Ted Dunning <
> > ted.dunning@gmail.com
> > > >
> > > > > > wrote:
> > > > > >
> > > > > > >
> > > > > > > Somebody needs to check signatures an checksums.  Also the
> NOTICE
> > > and
> > > > > > > LICENSE files.
> > > > > > >
> > > > > > > Repeating the tests others have done has some value but
> actually
> > > > > walking
> > > > > > > through the tutorial or intro documentation step by step has
> the
> > > > virtue
> > > > > > of
> > > > > > > breaking new ground.
> > > > > > >
> > > > > > > Sent from my iPhone
> > > > > > >
> > > > > > > > On Apr 30, 2015, at 11:31, Norris Lee <no...@simba.com>
> > wrote:
> > > > > > > >
> > > > > > > > +1 (non-binding)
> > > > > > > >
> > > > > > > > Downloaded source and built on Linux. Ran Hive, HBase, DFS
> > > queries
> > > > > > > through ODBC.
> > > > > > > >
> > > > > > > > Norris
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Jacques Nadeau [mailto:jacques@apache.org]
> > > > > > > > Sent: Wednesday, April 29, 2015 10:47 PM
> > > > > > > > Cc: dev@drill.apache.org
> > > > > > > > Subject: Re: [VOTE] Release Apache Drill 0.9.0 (rc1)
> > > > > > > >
> > > > > > > > Just to clarify, this incorporates a critical bug *FIX* found
> > in
> > > > rc0.
> > > > > > > >
> > > > > > > > :)
> > > > > > > >
> > > > > > > >> On Wed, Apr 29, 2015 at 10:14 PM, Jacques Nadeau <
> > > > > jacques@apache.org>
> > > > > > > wrote:
> > > > > > > >>
> > > > > > > >> Good evening,
> > > > > > > >>
> > > > > > > >> I would like to propose the release of Apache Drill, version
> > > > 0.9.0.
> > > > > > > >> This is the second release candidate (rc1) and incorporates
> a
> > > > > critical
> > > > > > > >> bug found in rc0 (DRILL-2916).
> > > > > > > >>
> > > > > > > >> This release includes 200 resolved JIRAs [1].
> > > > > > > >>
> > > > > > > >> The artifacts are hosted at [2].
> > > > > > > >>
> > > > > > > >> The vote will be open for ~72 hours, ending 22:00 Pacific,
> May
> > > 2,
> > > > > 2015
> > > > > > > >>
> > > > > > > >> [ ] +1
> > > > > > > >> [ ] +0
> > > > > > > >> [ ] -1
> > > > > > > >>
> > > > > > > >>
> > > > > > > >> Thank you,
> > > > > > > >> Jacques
> > > > > > > >>
> > > > > > > >> [1]
> > > > > > > >>
> > > > > >
> > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=1232881
> > > > > > > >> 3&projectId=12313820 [2]
> > > > > > > >> http://people.apache.org/~jacques/apache-drill-0.9.0.rc1/
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > >  Steven Phillips
> > > > >  Software Engineer
> > > > >
> > > > >  mapr.com
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] Release Apache Drill 0.9.0 (rc1)

Posted by Venki Korukanti <ve...@gmail.com>.
It looks like your existing storage plugin config has MapRDB as one of the
supported format plugin, but it can't find the implementation in your
current Drill installation. The .tar.gz file you got/built from apache.org
doesn't have the MapRDB plugin.

Two options:
1. Either remove the plugin info from storage conf (may need to modify the
files manually) or
2. Get the jar from your previous installation (look under jars folder -
assuming your prev installation is from a rpm/deb downloaded from mapr.com)
(I prefer this option)

Thanks
Venki

On Thu, Apr 30, 2015 at 3:50 PM, Alexander Zarei <alexanderz.simba@gmail.com
> wrote:

> Thanks Venki. I did and it went ahead one more step but now it cannot
> figure out the maprdb type; Marked below in bold.
>
> I googled it but not much relevant information was found. I wonder if you
> could suggest a direction to look into it.
>
> log4j:WARN No appenders could be found for logger
> (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> Exception in thread "main"
> org.apache.drill.exec.exception.DrillbitStartupException: Failure during
> initial startup of Drillbit.
>         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:87)
>         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
>         at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
> *Caused by: java.lang.RuntimeException:
> com.fasterxml.jackson.databind.JsonMappingException: Could not resolve type
> id 'maprdb' into a subtype of [simple type, class
> org.apache.drill.common.logical.FormatPluginConfig]*
>  at [Source: [B@927297a; line: 55, column: 7] (through reference chain:
>
> org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
>         at
>
> org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:197)
>         at
>
> org.apache.drill.exec.store.StoragePluginRegistry.createPlugins(StoragePluginRegistry.java:168)
>         at
>
> org.apache.drill.exec.store.StoragePluginRegistry.init(StoragePluginRegistry.java:132)
>         at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:244)
>         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:84)
>         ... 2 more
> Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could not
> resolve type id 'maprdb' into a subtype of [simple type, class
> org.apache.drill.common.logical.FormatPluginConfig]
>  at [Source: [B@927297a; line: 55, column: 7] (through reference chain:
>
> org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
>         at
>
> com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148)
>         at
>
> com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:849)
>         at
>
> com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:167)
>         at
>
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:99)
>         at
>
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84)
>         at
>
> com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132)
>         at
>
> com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:453)
>         at
>
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:311)
>         at
>
> com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26)
>         at
>
> com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:538)
>         at
>
> com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:106)
>         at
>
> com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:238)
>         at
>
> com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:151)
>         at
>
> com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:126)
>         at
>
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
>         at
>
> com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84)
>         at
>
> com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132)
>         at
>
> com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41)
>         at
>
> com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1269)
>         at
>
> com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:912)
>         at
>
> org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
>         at
>
> org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:195)
>
> Thanks,
> Alex
>
>
> On Thu, Apr 30, 2015 at 3:29 PM, Venki Korukanti <
> venki.korukanti@gmail.com>
> wrote:
>
> > MapR specific FileSystem implementation the requires following in JVM
> > options:
> >
> > export DRILLBIT_JAVA_OPTS="$DRILLBIT_JAVA_OPTS
> > -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf
> > -Dzookeeper.sasl.client=false "
> >
> > (You can put this in conf/drill-env.sh)
> >
> > Thanks
> > Venki
> >
> > On Thu, Apr 30, 2015 at 3:24 PM, Alexander Zarei <
> > alexanderz.simba@gmail.com
> > > wrote:
> >
> > > Hi,
> > >
> > > I downloaded a new MapR sandbox;
> > > Stopped the default Drillbit;
> > > Built form source and changed the zookeeper port from the default 2181
> to
> > > 5181 like the default drillbit.
> > >
> > > The new Drillbit does not start and throws the following error:
> > >
> > >
> > >
> > > log4j:WARN No appenders could be found for logger
> > > (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
> > > log4j:WARN Please initialize the log4j system properly.
> > > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
> for
> > > more info.
> > > Exception in thread "main"
> > > org.apache.drill.exec.exception.DrillbitStartupException: Failure while
> > > initializing values in Drillbit.
> > >         at
> org.apache.drill.exec.server.Drillbit.start(Drillbit.java:80)
> > >         at
> org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
> > >         at
> org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
> > > Caused by: org.apache.drill.common.exceptions.ExecutionSetupException:
> A
> > > System Table provider was either not specified or could not be found or
> > > instantiated
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:60)
> > >         at
> > org.apache.drill.exec.server.Drillbit.<init>(Drillbit.java:198)
> > >         at
> org.apache.drill.exec.server.Drillbit.start(Drillbit.java:78)
> > >         ... 2 more
> > > Caused by: java.lang.reflect.InvocationTargetException
> > >         at
> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > > Method)
> > >         at
> > >
> > >
> >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> > >         at
> > >
> > >
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> > >         at
> > java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:56)
> > >         ... 4 more
> > > Caused by: org.apache.drill.exec.exception.DrillbitStartupException:
> > > Failure while attempting to set up blob store.
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:65)
> > >         ... 9 more
> > > Caused by: java.io.IOException: failure to login: No LoginModules
> > > configured for hadoop_simple
> > >         at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:654)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:606)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:519)
> > >         at
> > > org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2590)
> > >         at
> > > org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2582)
> > >         at
> > org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2448)
> > >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:404)
> > >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:103)
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:99)
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.sys.local.FilePStore.getFileSystem(FilePStore.java:85)
> > >         at
> > >
> > >
> >
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:63)
> > >         ... 9 more
> > > Caused by: javax.security.auth.login.LoginException: No LoginModules
> > > configured for hadoop_simple
> > >         at
> > > javax.security.auth.login.LoginContext.init(LoginContext.java:272)
> > >         at
> > > javax.security.auth.login.LoginContext.<init>(LoginContext.java:389)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.newLoginContext(UserGroupInformation.java:408)
> > >         at
> > >
> > >
> >
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:626)
> > >         ... 20 more
> > >
> > >
> > > I wonder if I need to change any configuration?
> > >
> > > Thanks,
> > > Alex
> > >
> > >
> > > On Thu, Apr 30, 2015 at 2:17 PM, Steven Phillips <
> sphillips@maprtech.com
> > >
> > > wrote:
> > >
> > > > I just committed another fix, and I also included an option to revert
> > to
> > > > the old assignment code, in case further issues are found.
> > > >
> > > > On Thu, Apr 30, 2015 at 1:23 PM, Jacques Nadeau <ja...@apache.org>
> > > > wrote:
> > > >
> > > > > I just ran across another instance of DRILL-2916.  That sinks this
> > > > release
> > > > > candidate.  Steven, can you take another look?
> > > > >
> > > > >
> > > > >
> > > > > On Thu, Apr 30, 2015 at 12:42 PM, Ted Dunning <
> ted.dunning@gmail.com
> > >
> > > > > wrote:
> > > > >
> > > > > >
> > > > > > Somebody needs to check signatures an checksums.  Also the NOTICE
> > and
> > > > > > LICENSE files.
> > > > > >
> > > > > > Repeating the tests others have done has some value but actually
> > > > walking
> > > > > > through the tutorial or intro documentation step by step has the
> > > virtue
> > > > > of
> > > > > > breaking new ground.
> > > > > >
> > > > > > Sent from my iPhone
> > > > > >
> > > > > > > On Apr 30, 2015, at 11:31, Norris Lee <no...@simba.com>
> wrote:
> > > > > > >
> > > > > > > +1 (non-binding)
> > > > > > >
> > > > > > > Downloaded source and built on Linux. Ran Hive, HBase, DFS
> > queries
> > > > > > through ODBC.
> > > > > > >
> > > > > > > Norris
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Jacques Nadeau [mailto:jacques@apache.org]
> > > > > > > Sent: Wednesday, April 29, 2015 10:47 PM
> > > > > > > Cc: dev@drill.apache.org
> > > > > > > Subject: Re: [VOTE] Release Apache Drill 0.9.0 (rc1)
> > > > > > >
> > > > > > > Just to clarify, this incorporates a critical bug *FIX* found
> in
> > > rc0.
> > > > > > >
> > > > > > > :)
> > > > > > >
> > > > > > >> On Wed, Apr 29, 2015 at 10:14 PM, Jacques Nadeau <
> > > > jacques@apache.org>
> > > > > > wrote:
> > > > > > >>
> > > > > > >> Good evening,
> > > > > > >>
> > > > > > >> I would like to propose the release of Apache Drill, version
> > > 0.9.0.
> > > > > > >> This is the second release candidate (rc1) and incorporates a
> > > > critical
> > > > > > >> bug found in rc0 (DRILL-2916).
> > > > > > >>
> > > > > > >> This release includes 200 resolved JIRAs [1].
> > > > > > >>
> > > > > > >> The artifacts are hosted at [2].
> > > > > > >>
> > > > > > >> The vote will be open for ~72 hours, ending 22:00 Pacific, May
> > 2,
> > > > 2015
> > > > > > >>
> > > > > > >> [ ] +1
> > > > > > >> [ ] +0
> > > > > > >> [ ] -1
> > > > > > >>
> > > > > > >>
> > > > > > >> Thank you,
> > > > > > >> Jacques
> > > > > > >>
> > > > > > >> [1]
> > > > > > >>
> > > > >
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=1232881
> > > > > > >> 3&projectId=12313820 [2]
> > > > > > >> http://people.apache.org/~jacques/apache-drill-0.9.0.rc1/
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > >  Steven Phillips
> > > >  Software Engineer
> > > >
> > > >  mapr.com
> > > >
> > >
> >
>

Re: [VOTE] Release Apache Drill 0.9.0 (rc1)

Posted by Alexander Zarei <al...@gmail.com>.
Thanks Venki. I did and it went ahead one more step but now it cannot
figure out the maprdb type; Marked below in bold.

I googled it but not much relevant information was found. I wonder if you
could suggest a direction to look into it.

log4j:WARN No appenders could be found for logger
(com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
more info.
Exception in thread "main"
org.apache.drill.exec.exception.DrillbitStartupException: Failure during
initial startup of Drillbit.
        at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:87)
        at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
        at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
*Caused by: java.lang.RuntimeException:
com.fasterxml.jackson.databind.JsonMappingException: Could not resolve type
id 'maprdb' into a subtype of [simple type, class
org.apache.drill.common.logical.FormatPluginConfig]*
 at [Source: [B@927297a; line: 55, column: 7] (through reference chain:
org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
        at
org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:197)
        at
org.apache.drill.exec.store.StoragePluginRegistry.createPlugins(StoragePluginRegistry.java:168)
        at
org.apache.drill.exec.store.StoragePluginRegistry.init(StoragePluginRegistry.java:132)
        at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:244)
        at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:84)
        ... 2 more
Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could not
resolve type id 'maprdb' into a subtype of [simple type, class
org.apache.drill.common.logical.FormatPluginConfig]
 at [Source: [B@927297a; line: 55, column: 7] (through reference chain:
org.apache.drill.exec.store.dfs.FileSystemConfig["formats"]->java.util.LinkedHashMap["maprdb"])
        at
com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148)
        at
com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:849)
        at
com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:167)
        at
com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:99)
        at
com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84)
        at
com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132)
        at
com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:453)
        at
com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:311)
        at
com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26)
        at
com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:538)
        at
com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:106)
        at
com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:238)
        at
com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeOther(BeanDeserializer.java:151)
        at
com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:126)
        at
com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:113)
        at
com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:84)
        at
com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:132)
        at
com.fasterxml.jackson.databind.deser.impl.TypeWrappedDeserializer.deserialize(TypeWrappedDeserializer.java:41)
        at
com.fasterxml.jackson.databind.ObjectReader._bindAndClose(ObjectReader.java:1269)
        at
com.fasterxml.jackson.databind.ObjectReader.readValue(ObjectReader.java:912)
        at
org.apache.drill.exec.store.sys.serialize.JacksonSerializer.deserialize(JacksonSerializer.java:44)
        at
org.apache.drill.exec.store.sys.zk.ZkAbstractStore$Iter$DeferredEntry.getValue(ZkAbstractStore.java:195)

Thanks,
Alex


On Thu, Apr 30, 2015 at 3:29 PM, Venki Korukanti <ve...@gmail.com>
wrote:

> MapR specific FileSystem implementation the requires following in JVM
> options:
>
> export DRILLBIT_JAVA_OPTS="$DRILLBIT_JAVA_OPTS
> -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf
> -Dzookeeper.sasl.client=false "
>
> (You can put this in conf/drill-env.sh)
>
> Thanks
> Venki
>
> On Thu, Apr 30, 2015 at 3:24 PM, Alexander Zarei <
> alexanderz.simba@gmail.com
> > wrote:
>
> > Hi,
> >
> > I downloaded a new MapR sandbox;
> > Stopped the default Drillbit;
> > Built form source and changed the zookeeper port from the default 2181 to
> > 5181 like the default drillbit.
> >
> > The new Drillbit does not start and throws the following error:
> >
> >
> >
> > log4j:WARN No appenders could be found for logger
> > (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
> > log4j:WARN Please initialize the log4j system properly.
> > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> > more info.
> > Exception in thread "main"
> > org.apache.drill.exec.exception.DrillbitStartupException: Failure while
> > initializing values in Drillbit.
> >         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:80)
> >         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
> >         at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
> > Caused by: org.apache.drill.common.exceptions.ExecutionSetupException: A
> > System Table provider was either not specified or could not be found or
> > instantiated
> >         at
> >
> >
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:60)
> >         at
> org.apache.drill.exec.server.Drillbit.<init>(Drillbit.java:198)
> >         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:78)
> >         ... 2 more
> > Caused by: java.lang.reflect.InvocationTargetException
> >         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > Method)
> >         at
> >
> >
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> >         at
> >
> >
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> >         at
> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> >         at
> >
> >
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:56)
> >         ... 4 more
> > Caused by: org.apache.drill.exec.exception.DrillbitStartupException:
> > Failure while attempting to set up blob store.
> >         at
> >
> >
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:65)
> >         ... 9 more
> > Caused by: java.io.IOException: failure to login: No LoginModules
> > configured for hadoop_simple
> >         at
> >
> >
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:654)
> >         at
> >
> >
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:606)
> >         at
> >
> >
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:519)
> >         at
> > org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2590)
> >         at
> > org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2582)
> >         at
> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2448)
> >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:404)
> >         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
> >         at
> >
> >
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:103)
> >         at
> >
> >
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:99)
> >         at
> >
> >
> org.apache.drill.exec.store.sys.local.FilePStore.getFileSystem(FilePStore.java:85)
> >         at
> >
> >
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:63)
> >         ... 9 more
> > Caused by: javax.security.auth.login.LoginException: No LoginModules
> > configured for hadoop_simple
> >         at
> > javax.security.auth.login.LoginContext.init(LoginContext.java:272)
> >         at
> > javax.security.auth.login.LoginContext.<init>(LoginContext.java:389)
> >         at
> >
> >
> org.apache.hadoop.security.UserGroupInformation.newLoginContext(UserGroupInformation.java:408)
> >         at
> >
> >
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:626)
> >         ... 20 more
> >
> >
> > I wonder if I need to change any configuration?
> >
> > Thanks,
> > Alex
> >
> >
> > On Thu, Apr 30, 2015 at 2:17 PM, Steven Phillips <sphillips@maprtech.com
> >
> > wrote:
> >
> > > I just committed another fix, and I also included an option to revert
> to
> > > the old assignment code, in case further issues are found.
> > >
> > > On Thu, Apr 30, 2015 at 1:23 PM, Jacques Nadeau <ja...@apache.org>
> > > wrote:
> > >
> > > > I just ran across another instance of DRILL-2916.  That sinks this
> > > release
> > > > candidate.  Steven, can you take another look?
> > > >
> > > >
> > > >
> > > > On Thu, Apr 30, 2015 at 12:42 PM, Ted Dunning <ted.dunning@gmail.com
> >
> > > > wrote:
> > > >
> > > > >
> > > > > Somebody needs to check signatures an checksums.  Also the NOTICE
> and
> > > > > LICENSE files.
> > > > >
> > > > > Repeating the tests others have done has some value but actually
> > > walking
> > > > > through the tutorial or intro documentation step by step has the
> > virtue
> > > > of
> > > > > breaking new ground.
> > > > >
> > > > > Sent from my iPhone
> > > > >
> > > > > > On Apr 30, 2015, at 11:31, Norris Lee <no...@simba.com> wrote:
> > > > > >
> > > > > > +1 (non-binding)
> > > > > >
> > > > > > Downloaded source and built on Linux. Ran Hive, HBase, DFS
> queries
> > > > > through ODBC.
> > > > > >
> > > > > > Norris
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Jacques Nadeau [mailto:jacques@apache.org]
> > > > > > Sent: Wednesday, April 29, 2015 10:47 PM
> > > > > > Cc: dev@drill.apache.org
> > > > > > Subject: Re: [VOTE] Release Apache Drill 0.9.0 (rc1)
> > > > > >
> > > > > > Just to clarify, this incorporates a critical bug *FIX* found in
> > rc0.
> > > > > >
> > > > > > :)
> > > > > >
> > > > > >> On Wed, Apr 29, 2015 at 10:14 PM, Jacques Nadeau <
> > > jacques@apache.org>
> > > > > wrote:
> > > > > >>
> > > > > >> Good evening,
> > > > > >>
> > > > > >> I would like to propose the release of Apache Drill, version
> > 0.9.0.
> > > > > >> This is the second release candidate (rc1) and incorporates a
> > > critical
> > > > > >> bug found in rc0 (DRILL-2916).
> > > > > >>
> > > > > >> This release includes 200 resolved JIRAs [1].
> > > > > >>
> > > > > >> The artifacts are hosted at [2].
> > > > > >>
> > > > > >> The vote will be open for ~72 hours, ending 22:00 Pacific, May
> 2,
> > > 2015
> > > > > >>
> > > > > >> [ ] +1
> > > > > >> [ ] +0
> > > > > >> [ ] -1
> > > > > >>
> > > > > >>
> > > > > >> Thank you,
> > > > > >> Jacques
> > > > > >>
> > > > > >> [1]
> > > > > >>
> > > >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=1232881
> > > > > >> 3&projectId=12313820 [2]
> > > > > >> http://people.apache.org/~jacques/apache-drill-0.9.0.rc1/
> > > > > >>
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > >  Steven Phillips
> > >  Software Engineer
> > >
> > >  mapr.com
> > >
> >
>

Re: [VOTE] Release Apache Drill 0.9.0 (rc1)

Posted by Venki Korukanti <ve...@gmail.com>.
MapR specific FileSystem implementation the requires following in JVM
options:

export DRILLBIT_JAVA_OPTS="$DRILLBIT_JAVA_OPTS
-Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf
-Dzookeeper.sasl.client=false "

(You can put this in conf/drill-env.sh)

Thanks
Venki

On Thu, Apr 30, 2015 at 3:24 PM, Alexander Zarei <alexanderz.simba@gmail.com
> wrote:

> Hi,
>
> I downloaded a new MapR sandbox;
> Stopped the default Drillbit;
> Built form source and changed the zookeeper port from the default 2181 to
> 5181 like the default drillbit.
>
> The new Drillbit does not start and throws the following error:
>
>
>
> log4j:WARN No appenders could be found for logger
> (com.mapr.baseutils.cldbutils.CLDBRpcCommonUtils).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> Exception in thread "main"
> org.apache.drill.exec.exception.DrillbitStartupException: Failure while
> initializing values in Drillbit.
>         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:80)
>         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:66)
>         at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:166)
> Caused by: org.apache.drill.common.exceptions.ExecutionSetupException: A
> System Table provider was either not specified or could not be found or
> instantiated
>         at
>
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:60)
>         at org.apache.drill.exec.server.Drillbit.<init>(Drillbit.java:198)
>         at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:78)
>         ... 2 more
> Caused by: java.lang.reflect.InvocationTargetException
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>         at
>
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>         at
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>         at
>
> org.apache.drill.exec.store.sys.PStoreRegistry.newPStoreProvider(PStoreRegistry.java:56)
>         ... 4 more
> Caused by: org.apache.drill.exec.exception.DrillbitStartupException:
> Failure while attempting to set up blob store.
>         at
>
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:65)
>         ... 9 more
> Caused by: java.io.IOException: failure to login: No LoginModules
> configured for hadoop_simple
>         at
>
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:654)
>         at
>
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:606)
>         at
>
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:519)
>         at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2590)
>         at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2582)
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2448)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:404)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
>         at
>
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:103)
>         at
>
> org.apache.drill.exec.store.dfs.DrillFileSystem.<init>(DrillFileSystem.java:99)
>         at
>
> org.apache.drill.exec.store.sys.local.FilePStore.getFileSystem(FilePStore.java:85)
>         at
>
> org.apache.drill.exec.store.sys.zk.ZkPStoreProvider.<init>(ZkPStoreProvider.java:63)
>         ... 9 more
> Caused by: javax.security.auth.login.LoginException: No LoginModules
> configured for hadoop_simple
>         at
> javax.security.auth.login.LoginContext.init(LoginContext.java:272)
>         at
> javax.security.auth.login.LoginContext.<init>(LoginContext.java:389)
>         at
>
> org.apache.hadoop.security.UserGroupInformation.newLoginContext(UserGroupInformation.java:408)
>         at
>
> org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:626)
>         ... 20 more
>
>
> I wonder if I need to change any configuration?
>
> Thanks,
> Alex
>
>
> On Thu, Apr 30, 2015 at 2:17 PM, Steven Phillips <sp...@maprtech.com>
> wrote:
>
> > I just committed another fix, and I also included an option to revert to
> > the old assignment code, in case further issues are found.
> >
> > On Thu, Apr 30, 2015 at 1:23 PM, Jacques Nadeau <ja...@apache.org>
> > wrote:
> >
> > > I just ran across another instance of DRILL-2916.  That sinks this
> > release
> > > candidate.  Steven, can you take another look?
> > >
> > >
> > >
> > > On Thu, Apr 30, 2015 at 12:42 PM, Ted Dunning <te...@gmail.com>
> > > wrote:
> > >
> > > >
> > > > Somebody needs to check signatures an checksums.  Also the NOTICE and
> > > > LICENSE files.
> > > >
> > > > Repeating the tests others have done has some value but actually
> > walking
> > > > through the tutorial or intro documentation step by step has the
> virtue
> > > of
> > > > breaking new ground.
> > > >
> > > > Sent from my iPhone
> > > >
> > > > > On Apr 30, 2015, at 11:31, Norris Lee <no...@simba.com> wrote:
> > > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > Downloaded source and built on Linux. Ran Hive, HBase, DFS queries
> > > > through ODBC.
> > > > >
> > > > > Norris
> > > > >
> > > > > -----Original Message-----
> > > > > From: Jacques Nadeau [mailto:jacques@apache.org]
> > > > > Sent: Wednesday, April 29, 2015 10:47 PM
> > > > > Cc: dev@drill.apache.org
> > > > > Subject: Re: [VOTE] Release Apache Drill 0.9.0 (rc1)
> > > > >
> > > > > Just to clarify, this incorporates a critical bug *FIX* found in
> rc0.
> > > > >
> > > > > :)
> > > > >
> > > > >> On Wed, Apr 29, 2015 at 10:14 PM, Jacques Nadeau <
> > jacques@apache.org>
> > > > wrote:
> > > > >>
> > > > >> Good evening,
> > > > >>
> > > > >> I would like to propose the release of Apache Drill, version
> 0.9.0.
> > > > >> This is the second release candidate (rc1) and incorporates a
> > critical
> > > > >> bug found in rc0 (DRILL-2916).
> > > > >>
> > > > >> This release includes 200 resolved JIRAs [1].
> > > > >>
> > > > >> The artifacts are hosted at [2].
> > > > >>
> > > > >> The vote will be open for ~72 hours, ending 22:00 Pacific, May 2,
> > 2015
> > > > >>
> > > > >> [ ] +1
> > > > >> [ ] +0
> > > > >> [ ] -1
> > > > >>
> > > > >>
> > > > >> Thank you,
> > > > >> Jacques
> > > > >>
> > > > >> [1]
> > > > >>
> > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=1232881
> > > > >> 3&projectId=12313820 [2]
> > > > >> http://people.apache.org/~jacques/apache-drill-0.9.0.rc1/
> > > > >>
> > > >
> > >
> >
> >
> >
> > --
> >  Steven Phillips
> >  Software Engineer
> >
> >  mapr.com
> >
>