You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@metron.apache.org by danieljue <gi...@git.apache.org> on 2016/09/27 14:15:21 UTC

[GitHub] incubator-metron pull request #278: Metron 451

GitHub user danieljue opened a pull request:

    https://github.com/apache/incubator-metron/pull/278

    Metron 451

    Fix for METRON-451
    SerDeUtils - java.lang.ClassNotFoundException: org.apache.storm.shade.org.joda.time.DateTime
    
    Sorry guys and gals, forgot to put this fix in it's own branch, might have screwed up previous PR.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/Cognami/incubator-metron METRON-451

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-metron/pull/278.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #278
    
----
commit 6d54f7b09427a1859d073303e22ace64e42e21b3
Author: Daniel Jue <dj...@cognami.com>
Date:   2016-09-26T16:06:39Z

    Fixed package error.

commit 1e45d059067f50afeadc22da13e3320990585367
Author: Daniel Jue <dj...@cognami.com>
Date:   2016-09-27T14:07:47Z

    Fix for METRON-451
    SerDeUtils - java.lang.ClassNotFoundException: org.apache.storm.shade.org.joda.time.DateTime
    
    Took the same jodatime dependency from API's pom and put it in Common's pom.  Not sure how this was building otherwise--it should not have been build-able without this dependency visible to this module.
    
    Suggest adding the version number as a variable that is controlled at a parent pom's dependency management section, so that the version numbers don't get out of sync between modules.

commit 8f83fb439392ef221497dae1abdd7b5309102be2
Author: Daniel Jue <dj...@cognami.com>
Date:   2016-09-27T14:09:03Z

    Merge branch 'master' of https://github.com/apache/incubator-metron
    
    # By cstella (4) and others
    # Via cstella
    * 'master' of https://github.com/apache/incubator-metron:
      METRON-457 Correct GrokParser logging spelling error (mmiklavc via cestella) closes apache/incubator-metron#274
      METRON-449 JSONMapParser should unfold maps to arbitrary depths closes apache/incubator-metron#271
      METRON-453: Add a stellar shell function to open an external editor and return the editor's contents closes apache/incubator-metron#272
      METRON-452: Add rudimentary configuration management functions to Stellar closes apache/incubator-metron#269
      METRON-374: Add appropriate bundled 3rd party licenses to NOTICE and LICENSE where appropriate closes apache/incubator-metron#229
      flush
      METRON-427 Create Ambari Management Pack for Metron Installation closes apache/incubator-metron#266

commit 896dc51ca0989170e91be709ecd40d020aeb35b9
Author: Daniel Jue <dj...@cognami.com>
Date:   2016-09-27T14:12:17Z

    Revert "Fix for METRON-451"
    
    This reverts commit 1e45d059067f50afeadc22da13e3320990585367.

commit 75162567e6890f76f30d0b555724212045276afc
Author: Daniel Jue <dj...@cognami.com>
Date:   2016-09-27T14:07:47Z

    Fix for METRON-451
    SerDeUtils - java.lang.ClassNotFoundException: org.apache.storm.shade.org.joda.time.DateTime
    
    Took the same jodatime dependency from API's pom and put it in Common's pom.  Not sure how this was building otherwise--it should not have been build-able without this dependency visible to this module.
    
    Suggest adding the version number as a variable that is controlled at a parent pom's dependency management section, so that the version numbers don't get out of sync between modules.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-metron issue #278: Metron 451 SerDeUtils - java.lang.ClassNotFound...

Posted by danieljue <gi...@git.apache.org>.
Github user danieljue commented on the issue:

    https://github.com/apache/incubator-metron/pull/278
  
    Am I supposed to be able to build Metron from the command line on a Mac with Java 8?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-metron issue #278: Metron 451 SerDeUtils - java.lang.ClassNotFound...

Posted by danieljue <gi...@git.apache.org>.
Github user danieljue commented on the issue:

    https://github.com/apache/incubator-metron/pull/278
  
    @nickwallen , interesting because the jodatime dependency is already in that CSV (it was included in API, but had to add it to the Common module pom)
    
    Seems to  be failing at the same place as METRON-363 Fix Cisco ASA Parser :
    
    `Sep 27, 2016 1:28:55 AM com.google.inject.servlet.InternalServletModule$BackwardsCompatibleServletContextProvider get
    WARNING: You are attempting to use a deprecated API (specifically, attempting to @Inject ServletContext inside an eagerly created singleton. While we allow this for backwards compatibility, be warned that this MAY have unexpected behavior if you have more than one injector (with ServletModule) running in the same JVM. Please consult the Guice documentation at http://code.google.com/p/google-guice/wiki/Servlets for more information.
    Sep 27, 2016 1:28:55 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
    INFO: Registering org.apache.hadoop.yarn.webapp.YarnJacksonJaxbJsonProvider as a provider class
    Sep 27, 2016 1:28:55 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
    INFO: Registering org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.AHSWebServices as a root resource class
    Sep 27, 2016 1:28:55 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
    INFO: Registering org.apache.hadoop.yarn.server.timeline.webapp.TimelineWebServices as a root resource class
    Sep 27, 2016 1:28:55 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
    INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
    Sep 27, 2016 1:28:55 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
    INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
    Sep 27, 2016 1:28:55 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
    INFO: Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton"
    Sep 27, 2016 1:28:55 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
    INFO: Binding org.apache.hadoop.yarn.webapp.YarnJacksonJaxbJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
    Sep 27, 2016 1:28:55 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
    INFO: Binding org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.AHSWebServices to GuiceManagedComponentProvider with the scope "Singleton"
    Sep 27, 2016 1:28:55 AM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
    INFO: Binding org.apache.hadoop.yarn.server.timeline.webapp.TimelineWebServices to GuiceManagedComponentProvider with the scope "Singleton"
    2016-09-27 01:28:59,179 ERROR [Curator-TreeCache-0] curator.ConnectionState (ConnectionState.java:checkTimeouts(200)) - Connection timed out for connection string (127.0.0.1:48078) and timeout (15000) / elapsed (31009)
    org.apache.curator.CuratorConnectionLossException: KeeperErrorCode = ConnectionLoss
    	at org.apache.curator.ConnectionState.checkTimeouts(ConnectionState.java:197)
    	at org.apache.curator.ConnectionState.getZooKeeper(ConnectionState.java:87)
    	at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:115)
    	at org.apache.curator.framework.imps.CuratorFrameworkImpl.getZooKeeper(CuratorFrameworkImpl.java:477)
    	at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:214)
    	at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:203)
    	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
    	at org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:200)
    	at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:191)
    	at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:38)
    	at org.apache.curator.x.discovery.details.ServiceDiscoveryImpl.queryForNames(ServiceDiscoveryImpl.java:276)
    	at org.apache.metron.maas.discovery.ServiceDiscoverer.updateState(ServiceDiscoverer.java:129)
    	at org.apache.metron.maas.discovery.ServiceDiscoverer.lambda$new$2(ServiceDiscoverer.java:93)
    	at org.apache.metron.maas.discovery.ServiceDiscoverer$$Lambda$34/648409124.childEvent(Unknown Source)
    	at org.apache.curator.framework.recipes.cache.TreeCache$2.apply(TreeCache.java:685)
    	at org.apache.curator.framework.recipes.cache.TreeCache$2.apply(TreeCache.java:679)
    	at org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:92)
    	at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
    	at org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:84)
    	at org.apache.curator.framework.recipes.cache.TreeCache.callListeners(TreeCache.java:678)
    	at org.apache.curator.framework.recipes.cache.TreeCache.access$1400(TreeCache.java:69)
    	at org.apache.curator.framework.recipes.cache.TreeCache$4.run(TreeCache.java:790)
    	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    	at java.lang.Thread.run(Thread.java:745)`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-metron issue #278: Metron 451 SerDeUtils - java.lang.ClassNotFound...

Posted by cestella <gi...@git.apache.org>.
Github user cestella commented on the issue:

    https://github.com/apache/incubator-metron/pull/278
  
    So, maven from the command line should work.  Also the tests do function from intellij, I can attest.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-metron issue #278: Metron 451 SerDeUtils - java.lang.ClassNotFound...

Posted by nickwallen <gi...@git.apache.org>.
Github user nickwallen commented on the issue:

    https://github.com/apache/incubator-metron/pull/278
  
    It would be great if we could add a unit test that exercises this bug.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-metron issue #278: Metron 451 SerDeUtils - java.lang.ClassNotFound...

Posted by nickwallen <gi...@git.apache.org>.
Github user nickwallen commented on the issue:

    https://github.com/apache/incubator-metron/pull/278
  
    Actually sorry, I was thinking of your other outstanding PR.  For this one, I think we need some way to test the change.  If you can provide a means for testing, we can get some reviewers on this.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-metron issue #278: Metron 451 SerDeUtils - java.lang.ClassNotFound...

Posted by danieljue <gi...@git.apache.org>.
Github user danieljue commented on the issue:

    https://github.com/apache/incubator-metron/pull/278
  
    Roger that, will devise a test.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-metron issue #278: Metron 451 SerDeUtils - java.lang.ClassNotFound...

Posted by nickwallen <gi...@git.apache.org>.
Github user nickwallen commented on the issue:

    https://github.com/apache/incubator-metron/pull/278
  
    @danieljue - can you merge this branch with master?  hopefully then we can get a clean CI build.  if we get a good build, we can get your PR committed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-metron issue #278: Metron 451 SerDeUtils - java.lang.ClassNotFound...

Posted by danieljue <gi...@git.apache.org>.
Github user danieljue commented on the issue:

    https://github.com/apache/incubator-metron/pull/278
  
    Thanks for the info @cestella !
    
    I get build success on all the modules if I do `mvn clean install -U -DskipTests=true`  from the top level Metron directory.  ;)
    
    I think the integrations tests in maas-common that are getting triggered are causing builds to fail for me.  (Could be others if it would get passed that).
    
    I'll open a new ticket so this doesn't get lost in the weeds on this thread.
    
    



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-metron issue #278: Metron 451 SerDeUtils - java.lang.ClassNotFound...

Posted by nickwallen <gi...@git.apache.org>.
Github user nickwallen commented on the issue:

    https://github.com/apache/incubator-metron/pull/278
  
    The license check failed.  Take a look at the [`build_utils/README`](build_utils/README.md).  I believe we just need to update the `dependencies_with_url.csv` file with joda-time.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---