You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by Nigel Jones <ni...@gmail.com> on 2017/11/21 15:09:32 UTC
Build issues - inconsistent
I'm experiencing some issues getting the ranger build to work.
a) macOS (10.13.2 b4), oracle 8 *(152)
[INFO] HBase Security Plugin .............................. FAILURE [11:37 min]
[INFO] Running org.apache.ranger.authorization.hbase.HBaseRangerAuthorizationTest
Formatting using clusterid: testClusterID
[ERROR] Tests run: 20, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 690.138 s <<< FAILURE! - in org.apache.ranger.authorization.hbase.HBaseRangerAuthorizationTest
[ERROR] testTagBasedTablePolicy(org.apache.ranger.authorization.hbase.HBaseRangerAuthorizationTest) Time elapsed: 612.923 s <<< ERROR!
org.apache.hadoop.hbase.exceptions.TimeoutIOException: java.util.concurrent.TimeoutException: The procedure 18 is still running
at org.apache.ranger.authorization.hbase.HBaseRangerAuthorizationTest.testTagBasedTablePolicy(HBaseRangerAuthorizationTest.java:780)
Caused by: java.util.concurrent.TimeoutException: The procedure 18 is still running
at org.apache.ranger.authorization.hbase.HBaseRangerAuthorizationTest.testTagBasedTablePolicy(HBaseRangerAuthorizationTest.java:780)
>> This looks like potentially a timeout, though at 690s maybe in reality a logical issue
b) Ubuntu 17.10, MS Azure, openjdk 8 (151)
[INFO] Hive Security Plugin ............................... FAILURE [ 41.084 s]
ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console.
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 30.286 s <<< FAILURE! - in org.apache.ranger.services.hive.HIVERangerAuthorizerTest
[ERROR] org.apache.ranger.services.hive.HIVERangerAuthorizerTest Time elapsed: 30.286 s <<< ERROR!
java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:36781: java.net.ConnectException: Connection refused (Connection refused)
at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.setup(HIVERangerAuthorizerTest.java:103)
Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.setup(HIVERangerAuthorizerTest.java:103)
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.setup(HIVERangerAuthorizerTest.java:103)
>> This one is clearly a jdbc connection issue, perhaps hive didn't start ....
c) Ubuntu 16.04, our internal IBM cloudfoundry/openstack environment - open jdk 1.8 (151)
[INFO] KAFKA Security Plugin .............................. FAILURE [18:58 min]
[INFO] Running org.apache.ranger.authorization.kafka.authorizer.KafkaRangerAuthorizerGSSTest
log4j:WARN No appenders could be found for logger (org.apache.kerby.kerberos.kerb.identity.backend.AbstractIdentityBackend).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
[ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1,108.807 s <<< FAILURE! - in org.apache.ranger.authorization.kafka.authorizer.KafkaRangerAuthorizerGSSTest
[ERROR] testAuthorizedRead(org.apache.ranger.authorization.kafka.authorizer.KafkaRangerAuthorizerGSSTest) Time elapsed: 1,103.05 s <<< FAILURE!
java.lang.AssertionError
at org.apache.ranger.authorization.kafka.authorizer.KafkaRangerAuthorizerGSSTest.testAuthorizedRead(KafkaRangerAuthorizerGSSTest.java:243)
d) Same system as a) but a prior run:
[INFO] Security Admin Web Application ..................... FAILURE [01:20 min]
[ERROR] Failed to execute goal com.webcohesion.enunciate:enunciate-maven-plugin:2.8.0:docs (default) on project security-admin-web: freemarker.core._TemplateModelException: An error has occurred when reading existing sub-variable "securityRoles"; see cause exception! The type of the containing value was: extended_hash+string (com.webcohesion.enunciate.modules.jaxrs.api.impl.MethodImpl wrapped into f.e.b.StringModel)
[ERROR]
[ERROR] ----
[ERROR] FTL stack trace ("~" means nesting-related):
[ERROR] - Failed at: #assign securityRoles = method.securi... [in template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt" in macro "processResourceGroup" at line 556, column 11]
[ERROR] ~ Reached through: #nested [in template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt" in macro "boilerplate" at line 141, column 9]
[ERROR] ~ Reached through: @boilerplate title=(title + ": " + re... [in template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt" in macro "processResourceGroup" at line 518, column 5]
[ERROR] - Reached through: @file name=(resourceGroup.slug + ".ht... [in template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt" in macro "processResourceGroup" at line 517, column 3]
[ERROR] - Reached through: @processResourceGroup resourceGroup=r... [in template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt" at line 238, column 11]
[ERROR] ~ Reached through: #nested [in template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt" in macro "boilerplate" at line 141, column 9]
[ERROR] ~ Reached through: @boilerplate pagenav=pagenav [in template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt" at line 192, column 3]
[ERROR] - Reached through: @file name=indexPageName [in template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt" at line 181, column 1]
[ERROR] ----: InvocationTargetException: javax/annotation/security/RolesAllowed: javax.annotation.security.RolesAllowed
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :security-admin-web
>> ---
So that's 4 attempts, 4 different results. I could open JIRAs, but I'm concerned at the lack of consistency. What do I need to check in my dev environments? Are there additional prereqs not checked for in maven?
My Atlas builds are more consistent (occasional timeout, but generally sharing results with others)
Many thanks
Nigel Jones
nigel.l.jones@gmail.com
Re: Build issues - inconsistent
Posted by Nigel Jones <ni...@gmail.com>.
On 2017-11-22 14:46, "Nigel Jones"<ni...@gmail.com> wrote:
> Thanks, that helps... I'll get all three environments on 3.5.0 and then retry (after a pull)
Though the enunciator issue is resolved with maven 3.5.0, I'm currently to see the same other errors - one clean build (linux), 2 failures (linux, macos). I'll raise a JIRA on the two specific failures and take it from there...
Re: Build issues - inconsistent
Posted by Nigel Jones <ni...@gmail.com>.
On 2017-11-22 11:45, Colm O hEigeartaigh <co...@apache.org> wrote:
> I can't reproduce the test failures in Kafka, HBase or Hive. However, I can
> reproduce the build errors in security-admin. It's caused by this bug in
> Maven:
>
> https://issues.apache.org/jira/browse/MNG-6298
>
> The solution is to use Apache Maven 3.5.0 instead of 3.5.2.
Thanks, that helps... I'll get all three environments on 3.5.0 and then retry (after a pull)
I imagine this kind of error is rare, but wonder if it would be worth using the maven-enforcer-plugin to validate that at least the mvn version (and anything else we want to check) is a 'sane' version (for us). See https://issues.apache.org/jira/browse/ATLAS-2245?filter=-2. We could check only min 3.5.0, or I guess exclude 3.5.2 with a error OR WARNING if we wanted, could be clearer? I'm happy to propose a patch if this is felt to be useful (once I'm over my build issues!)
Re: Build issues - inconsistent
Posted by Colm O hEigeartaigh <co...@apache.org>.
I can't reproduce the test failures in Kafka, HBase or Hive. However, I can
reproduce the build errors in security-admin. It's caused by this bug in
Maven:
https://issues.apache.org/jira/browse/MNG-6298
The solution is to use Apache Maven 3.5.0 instead of 3.5.2.
Colm.
On Tue, Nov 21, 2017 at 5:19 PM, Nigel Jones <ni...@gmail.com>
wrote:
> Consistent in failing, but it's unclear how repeatable any specific error
> is... I'll try some more - this was the test from just 4 attempts so I
> wanted to check I was doing things correct.
>
> My invocation in each case is
> mvn -DskipTests=false clean compile package install assembly:assembly
>
> Maven versions were
> a) 3.5.2 (local mac)
> b) 3.5.0 (azure ubuntu 17.10)
> c) 3.3.9 (cloudfoundry/openstack ubuntu 16.04)
>
> We hit funny maven issues in Atlas - jenkins is now at 3.5.0. I proposed a
> validation check in ATLAS-2245 to persuade everyone to upgrade.
>
> I'm assuming lots of people here use macOS. Whilst my OS level is forward
> I doubt that's the issue. Is everyone still building with java 1.7? And
> what version of maven? Any other dependent components?
>
> Thanks
> Nigel.
>
> On 2017-11-21 15:48, Colm O hEigeartaigh <co...@apache.org> wrote:
> > What maven version are you using? Are the test failures consistent or
> > sporadic?
> >
> > Colm.
> >
> > On Tue, Nov 21, 2017 at 3:09 PM, Nigel Jones <ni...@gmail.com>
> > wrote:
> >
> > > I'm experiencing some issues getting the ranger build to work.
> > > a) macOS (10.13.2 b4), oracle 8 *(152)
> > >
> > > [INFO] HBase Security Plugin .............................. FAILURE
> [11:37
> > > min]
> > >
> > > [INFO] Running org.apache.ranger.authorization.hbase.
> > > HBaseRangerAuthorizationTest
> > > Formatting using clusterid: testClusterID
> > > [ERROR] Tests run: 20, Failures: 0, Errors: 1, Skipped: 0, Time
> elapsed:
> > > 690.138 s <<< FAILURE! - in org.apache.ranger.authorization.hbase.
> > > HBaseRangerAuthorizationTest
> > > [ERROR] testTagBasedTablePolicy(org.apache.ranger.authorization.hbase.
> HBaseRangerAuthorizationTest)
> > > Time elapsed: 612.923 s <<< ERROR!
> > > org.apache.hadoop.hbase.exceptions.TimeoutIOException:
> > > java.util.concurrent.TimeoutException: The procedure 18 is still
> running
> > > at org.apache.ranger.authorization.hbase.
> > > HBaseRangerAuthorizationTest.testTagBasedTablePolicy(
> > > HBaseRangerAuthorizationTest.java:780)
> > > Caused by: java.util.concurrent.TimeoutException: The procedure 18 is
> > > still running
> > > at org.apache.ranger.authorization.hbase.
> > > HBaseRangerAuthorizationTest.testTagBasedTablePolicy(
> > > HBaseRangerAuthorizationTest.java:780)
> > >
> > >
> > > >> This looks like potentially a timeout, though at 690s maybe in
> reality
> > > a logical issue
> > >
> > > b) Ubuntu 17.10, MS Azure, openjdk 8 (151)
> > >
> > > [INFO] Hive Security Plugin ............................... FAILURE [
> > > 41.084 s]
> > > ERROR StatusLogger No log4j2 configuration file found. Using default
> > > configuration: logging only errors to the console.
> > > [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> > > 30.286 s <<< FAILURE! - in org.apache.ranger.services.
> > > hive.HIVERangerAuthorizerTest
> > > [ERROR] org.apache.ranger.services.hive.HIVERangerAuthorizerTest Time
> > > elapsed: 30.286 s <<< ERROR!
> > > java.sql.SQLException: Could not open client transport with JDBC Uri:
> > > jdbc:hive2://localhost:36781: java.net.ConnectException: Connection
> refused
> > > (Connection refused)
> > > at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.
> setup(
> > > HIVERangerAuthorizerTest.java:103)
> > > Caused by: org.apache.thrift.transport.TTransportException:
> > > java.net.ConnectException: Connection refused (Connection refused)
> > > at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.
> setup(
> > > HIVERangerAuthorizerTest.java:103)
> > > Caused by: java.net.ConnectException: Connection refused (Connection
> > > refused)
> > > at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.
> setup(
> > > HIVERangerAuthorizerTest.java:103)
> > >
> > >
> > > >> This one is clearly a jdbc connection issue, perhaps hive didn't
> start
> > > ....
> > >
> > > c) Ubuntu 16.04, our internal IBM cloudfoundry/openstack environment -
> > > open jdk 1.8 (151)
> > >
> > > [INFO] KAFKA Security Plugin .............................. FAILURE
> [18:58
> > > min]
> > >
> > > [INFO] Running org.apache.ranger.authorization.kafka.authorizer.
> > > KafkaRangerAuthorizerGSSTest
> > > log4j:WARN No appenders could be found for logger
> > > (org.apache.kerby.kerberos.kerb.identity.backend.
> AbstractIdentityBackend).
> > > log4j:WARN Please initialize the log4j system properly.
> > > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig
> for
> > > more info.
> > > [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
> > > 1,108.807 s <<< FAILURE! - in org.apache.ranger.authorization.kafka.
> > > authorizer.KafkaRangerAuthorizerGSSTest
> > > [ERROR] testAuthorizedRead(org.apache.ranger.authorization.kafka.
> > > authorizer.KafkaRangerAuthorizerGSSTest) Time elapsed: 1,103.05 s
> <<<
> > > FAILURE!
> > > java.lang.AssertionError
> > > at org.apache.ranger.authorization.kafka.authorizer.
> > > KafkaRangerAuthorizerGSSTest.testAuthorizedRead(
> > > KafkaRangerAuthorizerGSSTest.java:243)
> > >
> > > d) Same system as a) but a prior run:
> > > [INFO] Security Admin Web Application ..................... FAILURE
> [01:20
> > > min]
> > >
> > > [ERROR] Failed to execute goal com.webcohesion.enunciate:
> > > enunciate-maven-plugin:2.8.0:docs (default) on project
> > > security-admin-web: freemarker.core._TemplateModelException: An error
> has
> > > occurred when reading existing sub-variable "securityRoles"; see cause
> > > exception! The type of the containing value was: extended_hash+string
> > > (com.webcohesion.enunciate.modules.jaxrs.api.impl.MethodImpl wrapped
> into
> > > f.e.b.StringModel)
> > > [ERROR]
> > > [ERROR] ----
> > > [ERROR] FTL stack trace ("~" means nesting-related):
> > > [ERROR] - Failed at: #assign securityRoles = method.securi...
> [in
> > > template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> > > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> > > com/webcohesion/enunciate/modules/docs/docs.fmt" in macro
> > > "processResourceGroup" at line 556, column 11]
> > > [ERROR] ~ Reached through: #nested [in template
> > > "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> > > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> > > com/webcohesion/enunciate/modules/docs/docs.fmt" in macro
> "boilerplate"
> > > at line 141, column 9]
> > > [ERROR] ~ Reached through: @boilerplate title=(title + ": " +
> > > re... [in template "jar:file:/Users/jonesn/.m2/
> > > repository/com/webcohesion/enunciate/enunciate-docs/2.8.
> > > 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/
> modules/docs/docs.fmt"
> > > in macro "processResourceGroup" at line 518, column 5]
> > > [ERROR] - Reached through: @file name=(resourceGroup.slug +
> > > ".ht... [in template "jar:file:/Users/jonesn/.m2/
> > > repository/com/webcohesion/enunciate/enunciate-docs/2.8.
> > > 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/
> modules/docs/docs.fmt"
> > > in macro "processResourceGroup" at line 517, column 3]
> > > [ERROR] - Reached through: @processResourceGroup
> > > resourceGroup=r... [in template "jar:file:/Users/jonesn/.m2/
> > > repository/com/webcohesion/enunciate/enunciate-docs/2.8.
> > > 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/
> modules/docs/docs.fmt"
> > > at line 238, column 11]
> > > [ERROR] ~ Reached through: #nested [in template
> > > "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> > > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> > > com/webcohesion/enunciate/modules/docs/docs.fmt" in macro
> "boilerplate"
> > > at line 141, column 9]
> > > [ERROR] ~ Reached through: @boilerplate pagenav=pagenav [in
> > > template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> > > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> > > com/webcohesion/enunciate/modules/docs/docs.fmt" at line 192, column
> 3]
> > > [ERROR] - Reached through: @file name=indexPageName [in
> template
> > > "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> > > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> > > com/webcohesion/enunciate/modules/docs/docs.fmt" at line 181, column
> 1]
> > > [ERROR] ----: InvocationTargetException: javax/annotation/security/
> RolesAllowed:
> > > javax.annotation.security.RolesAllowed
> > > [ERROR] -> [Help 1]
> > > [ERROR]
> > > [ERROR] To see the full stack trace of the errors, re-run Maven with
> the
> > > -e switch.
> > > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > > [ERROR]
> > > [ERROR] For more information about the errors and possible solutions,
> > > please read the following articles:
> > > [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
> > > MojoExecutionException
> > > [ERROR]
> > > [ERROR] After correcting the problems, you can resume the build with
> the
> > > command
> > > [ERROR] mvn <goals> -rf :security-admin-web
> > >
> > >
> > > >> ---
> > >
> > > So that's 4 attempts, 4 different results. I could open JIRAs, but I'm
> > > concerned at the lack of consistency. What do I need to check in my dev
> > > environments? Are there additional prereqs not checked for in maven?
> > >
> > > My Atlas builds are more consistent (occasional timeout, but generally
> > > sharing results with others)
> > >
> > > Many thanks
> > > Nigel Jones
> > > nigel.l.jones@gmail.com
> > >
> >
> >
> >
> > --
> > Colm O hEigeartaigh
> >
> > Talend Community Coder
> > http://coders.talend.com
> >
>
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com
Re: Build issues - inconsistent
Posted by Nigel Jones <ni...@gmail.com>.
Consistent in failing, but it's unclear how repeatable any specific error is... I'll try some more - this was the test from just 4 attempts so I wanted to check I was doing things correct.
My invocation in each case is
mvn -DskipTests=false clean compile package install assembly:assembly
Maven versions were
a) 3.5.2 (local mac)
b) 3.5.0 (azure ubuntu 17.10)
c) 3.3.9 (cloudfoundry/openstack ubuntu 16.04)
We hit funny maven issues in Atlas - jenkins is now at 3.5.0. I proposed a validation check in ATLAS-2245 to persuade everyone to upgrade.
I'm assuming lots of people here use macOS. Whilst my OS level is forward I doubt that's the issue. Is everyone still building with java 1.7? And what version of maven? Any other dependent components?
Thanks
Nigel.
On 2017-11-21 15:48, Colm O hEigeartaigh <co...@apache.org> wrote:
> What maven version are you using? Are the test failures consistent or
> sporadic?
>
> Colm.
>
> On Tue, Nov 21, 2017 at 3:09 PM, Nigel Jones <ni...@gmail.com>
> wrote:
>
> > I'm experiencing some issues getting the ranger build to work.
> > a) macOS (10.13.2 b4), oracle 8 *(152)
> >
> > [INFO] HBase Security Plugin .............................. FAILURE [11:37
> > min]
> >
> > [INFO] Running org.apache.ranger.authorization.hbase.
> > HBaseRangerAuthorizationTest
> > Formatting using clusterid: testClusterID
> > [ERROR] Tests run: 20, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> > 690.138 s <<< FAILURE! - in org.apache.ranger.authorization.hbase.
> > HBaseRangerAuthorizationTest
> > [ERROR] testTagBasedTablePolicy(org.apache.ranger.authorization.hbase.HBaseRangerAuthorizationTest)
> > Time elapsed: 612.923 s <<< ERROR!
> > org.apache.hadoop.hbase.exceptions.TimeoutIOException:
> > java.util.concurrent.TimeoutException: The procedure 18 is still running
> > at org.apache.ranger.authorization.hbase.
> > HBaseRangerAuthorizationTest.testTagBasedTablePolicy(
> > HBaseRangerAuthorizationTest.java:780)
> > Caused by: java.util.concurrent.TimeoutException: The procedure 18 is
> > still running
> > at org.apache.ranger.authorization.hbase.
> > HBaseRangerAuthorizationTest.testTagBasedTablePolicy(
> > HBaseRangerAuthorizationTest.java:780)
> >
> >
> > >> This looks like potentially a timeout, though at 690s maybe in reality
> > a logical issue
> >
> > b) Ubuntu 17.10, MS Azure, openjdk 8 (151)
> >
> > [INFO] Hive Security Plugin ............................... FAILURE [
> > 41.084 s]
> > ERROR StatusLogger No log4j2 configuration file found. Using default
> > configuration: logging only errors to the console.
> > [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> > 30.286 s <<< FAILURE! - in org.apache.ranger.services.
> > hive.HIVERangerAuthorizerTest
> > [ERROR] org.apache.ranger.services.hive.HIVERangerAuthorizerTest Time
> > elapsed: 30.286 s <<< ERROR!
> > java.sql.SQLException: Could not open client transport with JDBC Uri:
> > jdbc:hive2://localhost:36781: java.net.ConnectException: Connection refused
> > (Connection refused)
> > at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.setup(
> > HIVERangerAuthorizerTest.java:103)
> > Caused by: org.apache.thrift.transport.TTransportException:
> > java.net.ConnectException: Connection refused (Connection refused)
> > at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.setup(
> > HIVERangerAuthorizerTest.java:103)
> > Caused by: java.net.ConnectException: Connection refused (Connection
> > refused)
> > at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.setup(
> > HIVERangerAuthorizerTest.java:103)
> >
> >
> > >> This one is clearly a jdbc connection issue, perhaps hive didn't start
> > ....
> >
> > c) Ubuntu 16.04, our internal IBM cloudfoundry/openstack environment -
> > open jdk 1.8 (151)
> >
> > [INFO] KAFKA Security Plugin .............................. FAILURE [18:58
> > min]
> >
> > [INFO] Running org.apache.ranger.authorization.kafka.authorizer.
> > KafkaRangerAuthorizerGSSTest
> > log4j:WARN No appenders could be found for logger
> > (org.apache.kerby.kerberos.kerb.identity.backend.AbstractIdentityBackend).
> > log4j:WARN Please initialize the log4j system properly.
> > log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> > more info.
> > [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
> > 1,108.807 s <<< FAILURE! - in org.apache.ranger.authorization.kafka.
> > authorizer.KafkaRangerAuthorizerGSSTest
> > [ERROR] testAuthorizedRead(org.apache.ranger.authorization.kafka.
> > authorizer.KafkaRangerAuthorizerGSSTest) Time elapsed: 1,103.05 s <<<
> > FAILURE!
> > java.lang.AssertionError
> > at org.apache.ranger.authorization.kafka.authorizer.
> > KafkaRangerAuthorizerGSSTest.testAuthorizedRead(
> > KafkaRangerAuthorizerGSSTest.java:243)
> >
> > d) Same system as a) but a prior run:
> > [INFO] Security Admin Web Application ..................... FAILURE [01:20
> > min]
> >
> > [ERROR] Failed to execute goal com.webcohesion.enunciate:
> > enunciate-maven-plugin:2.8.0:docs (default) on project
> > security-admin-web: freemarker.core._TemplateModelException: An error has
> > occurred when reading existing sub-variable "securityRoles"; see cause
> > exception! The type of the containing value was: extended_hash+string
> > (com.webcohesion.enunciate.modules.jaxrs.api.impl.MethodImpl wrapped into
> > f.e.b.StringModel)
> > [ERROR]
> > [ERROR] ----
> > [ERROR] FTL stack trace ("~" means nesting-related):
> > [ERROR] - Failed at: #assign securityRoles = method.securi... [in
> > template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> > com/webcohesion/enunciate/modules/docs/docs.fmt" in macro
> > "processResourceGroup" at line 556, column 11]
> > [ERROR] ~ Reached through: #nested [in template
> > "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> > com/webcohesion/enunciate/modules/docs/docs.fmt" in macro "boilerplate"
> > at line 141, column 9]
> > [ERROR] ~ Reached through: @boilerplate title=(title + ": " +
> > re... [in template "jar:file:/Users/jonesn/.m2/
> > repository/com/webcohesion/enunciate/enunciate-docs/2.8.
> > 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt"
> > in macro "processResourceGroup" at line 518, column 5]
> > [ERROR] - Reached through: @file name=(resourceGroup.slug +
> > ".ht... [in template "jar:file:/Users/jonesn/.m2/
> > repository/com/webcohesion/enunciate/enunciate-docs/2.8.
> > 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt"
> > in macro "processResourceGroup" at line 517, column 3]
> > [ERROR] - Reached through: @processResourceGroup
> > resourceGroup=r... [in template "jar:file:/Users/jonesn/.m2/
> > repository/com/webcohesion/enunciate/enunciate-docs/2.8.
> > 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt"
> > at line 238, column 11]
> > [ERROR] ~ Reached through: #nested [in template
> > "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> > com/webcohesion/enunciate/modules/docs/docs.fmt" in macro "boilerplate"
> > at line 141, column 9]
> > [ERROR] ~ Reached through: @boilerplate pagenav=pagenav [in
> > template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> > com/webcohesion/enunciate/modules/docs/docs.fmt" at line 192, column 3]
> > [ERROR] - Reached through: @file name=indexPageName [in template
> > "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> > enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> > com/webcohesion/enunciate/modules/docs/docs.fmt" at line 181, column 1]
> > [ERROR] ----: InvocationTargetException: javax/annotation/security/RolesAllowed:
> > javax.annotation.security.RolesAllowed
> > [ERROR] -> [Help 1]
> > [ERROR]
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
> > -e switch.
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions,
> > please read the following articles:
> > [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
> > MojoExecutionException
> > [ERROR]
> > [ERROR] After correcting the problems, you can resume the build with the
> > command
> > [ERROR] mvn <goals> -rf :security-admin-web
> >
> >
> > >> ---
> >
> > So that's 4 attempts, 4 different results. I could open JIRAs, but I'm
> > concerned at the lack of consistency. What do I need to check in my dev
> > environments? Are there additional prereqs not checked for in maven?
> >
> > My Atlas builds are more consistent (occasional timeout, but generally
> > sharing results with others)
> >
> > Many thanks
> > Nigel Jones
> > nigel.l.jones@gmail.com
> >
>
>
>
> --
> Colm O hEigeartaigh
>
> Talend Community Coder
> http://coders.talend.com
>
Re: Build issues - inconsistent
Posted by Colm O hEigeartaigh <co...@apache.org>.
What maven version are you using? Are the test failures consistent or
sporadic?
Colm.
On Tue, Nov 21, 2017 at 3:09 PM, Nigel Jones <ni...@gmail.com>
wrote:
> I'm experiencing some issues getting the ranger build to work.
> a) macOS (10.13.2 b4), oracle 8 *(152)
>
> [INFO] HBase Security Plugin .............................. FAILURE [11:37
> min]
>
> [INFO] Running org.apache.ranger.authorization.hbase.
> HBaseRangerAuthorizationTest
> Formatting using clusterid: testClusterID
> [ERROR] Tests run: 20, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 690.138 s <<< FAILURE! - in org.apache.ranger.authorization.hbase.
> HBaseRangerAuthorizationTest
> [ERROR] testTagBasedTablePolicy(org.apache.ranger.authorization.hbase.HBaseRangerAuthorizationTest)
> Time elapsed: 612.923 s <<< ERROR!
> org.apache.hadoop.hbase.exceptions.TimeoutIOException:
> java.util.concurrent.TimeoutException: The procedure 18 is still running
> at org.apache.ranger.authorization.hbase.
> HBaseRangerAuthorizationTest.testTagBasedTablePolicy(
> HBaseRangerAuthorizationTest.java:780)
> Caused by: java.util.concurrent.TimeoutException: The procedure 18 is
> still running
> at org.apache.ranger.authorization.hbase.
> HBaseRangerAuthorizationTest.testTagBasedTablePolicy(
> HBaseRangerAuthorizationTest.java:780)
>
>
> >> This looks like potentially a timeout, though at 690s maybe in reality
> a logical issue
>
> b) Ubuntu 17.10, MS Azure, openjdk 8 (151)
>
> [INFO] Hive Security Plugin ............................... FAILURE [
> 41.084 s]
> ERROR StatusLogger No log4j2 configuration file found. Using default
> configuration: logging only errors to the console.
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 30.286 s <<< FAILURE! - in org.apache.ranger.services.
> hive.HIVERangerAuthorizerTest
> [ERROR] org.apache.ranger.services.hive.HIVERangerAuthorizerTest Time
> elapsed: 30.286 s <<< ERROR!
> java.sql.SQLException: Could not open client transport with JDBC Uri:
> jdbc:hive2://localhost:36781: java.net.ConnectException: Connection refused
> (Connection refused)
> at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.setup(
> HIVERangerAuthorizerTest.java:103)
> Caused by: org.apache.thrift.transport.TTransportException:
> java.net.ConnectException: Connection refused (Connection refused)
> at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.setup(
> HIVERangerAuthorizerTest.java:103)
> Caused by: java.net.ConnectException: Connection refused (Connection
> refused)
> at org.apache.ranger.services.hive.HIVERangerAuthorizerTest.setup(
> HIVERangerAuthorizerTest.java:103)
>
>
> >> This one is clearly a jdbc connection issue, perhaps hive didn't start
> ....
>
> c) Ubuntu 16.04, our internal IBM cloudfoundry/openstack environment -
> open jdk 1.8 (151)
>
> [INFO] KAFKA Security Plugin .............................. FAILURE [18:58
> min]
>
> [INFO] Running org.apache.ranger.authorization.kafka.authorizer.
> KafkaRangerAuthorizerGSSTest
> log4j:WARN No appenders could be found for logger
> (org.apache.kerby.kerberos.kerb.identity.backend.AbstractIdentityBackend).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> [ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
> 1,108.807 s <<< FAILURE! - in org.apache.ranger.authorization.kafka.
> authorizer.KafkaRangerAuthorizerGSSTest
> [ERROR] testAuthorizedRead(org.apache.ranger.authorization.kafka.
> authorizer.KafkaRangerAuthorizerGSSTest) Time elapsed: 1,103.05 s <<<
> FAILURE!
> java.lang.AssertionError
> at org.apache.ranger.authorization.kafka.authorizer.
> KafkaRangerAuthorizerGSSTest.testAuthorizedRead(
> KafkaRangerAuthorizerGSSTest.java:243)
>
> d) Same system as a) but a prior run:
> [INFO] Security Admin Web Application ..................... FAILURE [01:20
> min]
>
> [ERROR] Failed to execute goal com.webcohesion.enunciate:
> enunciate-maven-plugin:2.8.0:docs (default) on project
> security-admin-web: freemarker.core._TemplateModelException: An error has
> occurred when reading existing sub-variable "securityRoles"; see cause
> exception! The type of the containing value was: extended_hash+string
> (com.webcohesion.enunciate.modules.jaxrs.api.impl.MethodImpl wrapped into
> f.e.b.StringModel)
> [ERROR]
> [ERROR] ----
> [ERROR] FTL stack trace ("~" means nesting-related):
> [ERROR] - Failed at: #assign securityRoles = method.securi... [in
> template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> com/webcohesion/enunciate/modules/docs/docs.fmt" in macro
> "processResourceGroup" at line 556, column 11]
> [ERROR] ~ Reached through: #nested [in template
> "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> com/webcohesion/enunciate/modules/docs/docs.fmt" in macro "boilerplate"
> at line 141, column 9]
> [ERROR] ~ Reached through: @boilerplate title=(title + ": " +
> re... [in template "jar:file:/Users/jonesn/.m2/
> repository/com/webcohesion/enunciate/enunciate-docs/2.8.
> 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt"
> in macro "processResourceGroup" at line 518, column 5]
> [ERROR] - Reached through: @file name=(resourceGroup.slug +
> ".ht... [in template "jar:file:/Users/jonesn/.m2/
> repository/com/webcohesion/enunciate/enunciate-docs/2.8.
> 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt"
> in macro "processResourceGroup" at line 517, column 3]
> [ERROR] - Reached through: @processResourceGroup
> resourceGroup=r... [in template "jar:file:/Users/jonesn/.m2/
> repository/com/webcohesion/enunciate/enunciate-docs/2.8.
> 0/enunciate-docs-2.8.0.jar!/com/webcohesion/enunciate/modules/docs/docs.fmt"
> at line 238, column 11]
> [ERROR] ~ Reached through: #nested [in template
> "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> com/webcohesion/enunciate/modules/docs/docs.fmt" in macro "boilerplate"
> at line 141, column 9]
> [ERROR] ~ Reached through: @boilerplate pagenav=pagenav [in
> template "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> com/webcohesion/enunciate/modules/docs/docs.fmt" at line 192, column 3]
> [ERROR] - Reached through: @file name=indexPageName [in template
> "jar:file:/Users/jonesn/.m2/repository/com/webcohesion/
> enunciate/enunciate-docs/2.8.0/enunciate-docs-2.8.0.jar!/
> com/webcohesion/enunciate/modules/docs/docs.fmt" at line 181, column 1]
> [ERROR] ----: InvocationTargetException: javax/annotation/security/RolesAllowed:
> javax.annotation.security.RolesAllowed
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
> MojoExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn <goals> -rf :security-admin-web
>
>
> >> ---
>
> So that's 4 attempts, 4 different results. I could open JIRAs, but I'm
> concerned at the lack of consistency. What do I need to check in my dev
> environments? Are there additional prereqs not checked for in maven?
>
> My Atlas builds are more consistent (occasional timeout, but generally
> sharing results with others)
>
> Many thanks
> Nigel Jones
> nigel.l.jones@gmail.com
>
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com