You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rya.apache.org by Adina Crainiceanu <ad...@usna.edu> on 2017/08/15 18:54:30 UTC
Re: next release of Rya?
Ping...
Are there any PRs left that really need to be merged for the next release?
Will Aaron be the release manager, or do we have another volunteer? I think
the sooner we can have a release the better it is.
Thanks,
Adina
On Tue, May 9, 2017 at 11:09 AM, Aaron D. Mihalik <aa...@gmail.com>
wrote:
> Whoops. This looks like the culprit:
>
> maven-surefire-plugin: <exclude> **/*IntegrationTest.java </exclude>
>
> https://github.com/apache/incubator-rya/blob/master/pom.xml#L886
>
> There's a JIRA Ticket out there to fix this. I'm going to continue this
> thread on the ticket.
>
> https://issues.apache.org/jira/browse/RYA-279
>
> --Aaron
>
> On Sat, May 6, 2017 at 10:01 AM Jonathan Wonders <jw...@gmail.com>
> wrote:
>
> > Sorry for the duplicate. I accidentally hit send too soon.
> >
> > On Sat, May 6, 2017 at 9:56 AM, Jonathan Wonders <jw...@gmail.com>
> > wrote:
> >
> > > Aaron,
> > >
> > > I think there must be a filter being applied in the Jenkins builds
> > because
> > > when I comb through the build logs, I am not seeing the tests that are
> > > failing on my machine being executed by Jenkins. The tests that are
> not
> > > being executed might have suffixes that cause them to be filtered out.
> > > Some require the minicluster and I don't think any of those are run
> > during
> > > the jenkins build just given the build time.
> > >
> > > Environment:
> > > - Windows
> > > - Hadoop 2.6.0 binaries
> > >
> > > mvn clean install / executing tests individually in intellij
> > > no profiles
> > >
> > > There are a few assertion errors
> > >
> > > *PrecompJoinOptimizerIntegrationTest::testEvaluateTwoIndexUnionFilter*
> -
> > > expected 6, actual 2
> > > *PrecompJoinOptimizerTest2::testContextFilter1*
> > > assertTrue at the end fails
> > >
> > > Here are some other errors that I've seen.
> > >
> > > *AccumuloUninstallIT::uninstall*
> > >
> > > org.apache.rya.api.client.RyaClientException: Could not initialize
> all of
> > > the tables for the new Rya instance. This instance may be left in a bad
> > > state.
> > >
> > > at org.apache.rya.api.client.accumulo.AccumuloInstall.
> > > install(AccumuloInstall.java:107)
> > > at org.apache.rya.api.client.accumulo.AccumuloUninstallIT.
> > > uninstall(AccumuloUninstallIT.java:69)
> > > Caused by: org.apache.rya.api.persist.RyaDAOException:
> > > org.apache.fluo.api.exceptions.FluoException: Failed to construct
> > > org.apache.fluo.core.client.FluoClientImpl class due to exception
> > > at org.apache.rya.accumulo.AccumuloRyaDAO.init(
> AccumuloRyaDAO.java:165)
> > > at org.apache.rya.sail.config.RyaSailFactory.getAccumuloDAO(
> > > RyaSailFactory.java:144)
> > > at org.apache.rya.sail.config.RyaSailFactory.getRyaSail(
> > > RyaSailFactory.java:102)
> > > at org.apache.rya.sail.config.RyaSailFactory.getInstance(
> > > RyaSailFactory.java:69)
> > > at org.apache.rya.api.client.accumulo.AccumuloInstall.
> > > install(AccumuloInstall.java:104)
> > > ... 34 more
> > > Caused by: org.apache.fluo.api.exceptions.FluoException: Failed to
> > > construct org.apache.fluo.core.client.FluoClientImpl class due to
> > > exception
> > > at org.apache.fluo.api.client.FluoFactory.buildClassWithConfig(
> > > FluoFactory.java:127)
> > > at org.apache.fluo.api.client.FluoFactory.getAndBuildClassWithConfig(
> > > FluoFactory.java:110)
> > > at org.apache.fluo.api.client.FluoFactory.newClient(
> FluoFactory.java:64)
> > > at org.apache.rya.indexing.external.fluo.FluoPcjUpdaterSupplier.get(
> > > FluoPcjUpdaterSupplier.java:94)
> > > at org.apache.rya.indexing.external.fluo.FluoPcjUpdaterSupplier.get(
> > > FluoPcjUpdaterSupplier.java:46)
> > > at com.google.common.base.Suppliers$MemoizingSupplier.
> > > get(Suppliers.java:125)
> > > at org.apache.rya.indexing.external.PrecomputedJoinIndexer.init(
> > > PrecomputedJoinIndexer.java:141)
> > > at org.apache.rya.accumulo.AccumuloRyaDAO.init(
> AccumuloRyaDAO.java:156)
> > > ... 38 more
> > > Caused by: java.lang.IllegalStateException:
> > java.lang.IllegalStateException:
> > > org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode
> =
> > > NoNode for /config/accumulo.instance.name
> > > at org.apache.fluo.core.client.FluoClientImpl.<init>(
> > > FluoClientImpl.java:62)
> > > *AccumuloGetInstanceDetailsIT*
> > >
> > > org.apache.rya.api.client.RyaClientException: Could not initialize
> all of
> > > the tables for the new Rya instance. This instance may be left in a bad
> > > state.
> > >
> > > at org.apache.rya.api.client.accumulo.AccumuloInstall.
> > > install(AccumuloInstall.java:107)
> > > at org.apache.rya.api.client.accumulo.AccumuloUninstallIT.
> > > uninstall(AccumuloUninstallIT.java:69)
> > > Caused by: org.apache.rya.api.persist.RyaDAOException:
> > > org.apache.fluo.api.exceptions.FluoException: Failed to construct
> > > org.apache.fluo.core.client.FluoClientImpl class due to exception
> > > at org.apache.rya.accumulo.AccumuloRyaDAO.init(
> AccumuloRyaDAO.java:165)
> > > at org.apache.rya.sail.config.RyaSailFactory.getAccumuloDAO(
> > > RyaSailFactory.java:144)
> > > at org.apache.rya.sail.config.RyaSailFactory.getRyaSail(
> > > RyaSailFactory.java:102)
> > > at org.apache.rya.sail.config.RyaSailFactory.getInstance(
> > > RyaSailFactory.java:69)
> > > at org.apache.rya.api.client.accumulo.AccumuloInstall.
> > > install(AccumuloInstall.java:104)
> > > ... 34 more
> > > Caused by: org.apache.fluo.api.exceptions.FluoException: Failed to
> > > construct org.apache.fluo.core.client.FluoClientImpl class due to
> > > exception
> > > at org.apache.fluo.api.client.FluoFactory.buildClassWithConfig(
> > > FluoFactory.java:127)
> > > at org.apache.fluo.api.client.FluoFactory.getAndBuildClassWithConfig(
> > > FluoFactory.java:110)
> > > at org.apache.fluo.api.client.FluoFactory.newClient(
> FluoFactory.java:64)
> > > at org.apache.rya.indexing.external.fluo.FluoPcjUpdaterSupplier.get(
> > > FluoPcjUpdaterSupplier.java:94)
> > > at org.apache.rya.indexing.external.fluo.FluoPcjUpdaterSupplier.get(
> > > FluoPcjUpdaterSupplier.java:46)
> > > at com.google.common.base.Suppliers$MemoizingSupplier.
> > > get(Suppliers.java:125)
> > > at org.apache.rya.indexing.external.PrecomputedJoinIndexer.init(
> > > PrecomputedJoinIndexer.java:141)
> > > at org.apache.rya.accumulo.AccumuloRyaDAO.init(
> AccumuloRyaDAO.java:156)
> > > ... 38 more
> > > Caused by: java.lang.IllegalStateException:
> > java.lang.IllegalStateException:
> > > org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode
> =
> > > NoNode for /config/accumulo.instance.name
> > > at org.apache.fluo.core.client.FluoClientImpl.<init>(
> > > FluoClientImpl.java:62)
> > >
> > > *AccumuloGetInstanceDetailsIT::getDetails*
> > >
> > > org.apache.rya.api.client.RyaClientException: Could not initialize
> all of
> > > the tables for the new Rya instance. This instance may be left in a bad
> > > state.
> > >
> > > at org.apache.rya.api.client.accumulo.AccumuloInstall.
> > > install(AccumuloInstall.java:107)
> > > at org.apache.rya.api.client.accumulo.AccumuloGetInstanceDetailsIT.
> > > getDetails(AccumuloGetInstanceDetailsIT.java:76)
> > > ...
> > > Caused by: org.apache.rya.api.persist.RyaDAOException:
> > > org.apache.fluo.api.exceptions.FluoException: Failed to construct
> > > org.apache.fluo.core.client.FluoClientImpl class due to exception
> > > at org.apache.rya.accumulo.AccumuloRyaDAO.init(
> AccumuloRyaDAO.java:165)
> > > at org.apache.rya.sail.config.RyaSailFactory.getAccumuloDAO(
> > > RyaSailFactory.java:142)
> > > at org.apache.rya.sail.config.RyaSailFactory.getRyaSail(
> > > RyaSailFactory.java:100)
> > > at org.apache.rya.sail.config.RyaSailFactory.getInstance(
> > > RyaSailFactory.java:67)
> > > at org.apache.rya.api.client.accumulo.AccumuloInstall.
> > > install(AccumuloInstall.java:104)
> > > ... 26 more
> > > Caused by: org.apache.fluo.api.exceptions.FluoException: Failed to
> > > construct org.apache.fluo.core.client.FluoClientImpl class due to
> > > exception
> > > at org.apache.fluo.api.client.FluoFactory.buildClassWithConfig(
> > > FluoFactory.java:127)
> > > at org.apache.fluo.api.client.FluoFactory.getAndBuildClassWithConfig(
> > > FluoFactory.java:110)
> > > at org.apache.fluo.api.client.FluoFactory.newClient(
> FluoFactory.java:64)
> > > at org.apache.rya.indexing.external.fluo.FluoPcjUpdaterSupplier.get(
> > > FluoPcjUpdaterSupplier.java:94)
> > > at org.apache.rya.indexing.external.fluo.FluoPcjUpdaterSupplier.get(
> > > FluoPcjUpdaterSupplier.java:46)
> > > at com.google.common.base.Suppliers$MemoizingSupplier.
> > > get(Suppliers.java:125)
> > > at org.apache.rya.indexing.external.PrecomputedJoinIndexer.init(
> > > PrecomputedJoinIndexer.java:141)
> > > at org.apache.rya.accumulo.AccumuloRyaDAO.init(
> AccumuloRyaDAO.java:156)
> > > ... 30 more
> > > Caused by: java.lang.reflect.InvocationTargetException
> > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
> > > at sun.reflect.NativeConstructorAccessorImpl.newInstance(
> > > NativeConstructorAccessorImpl.java:62)
> > > at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
> > > DelegatingConstructorAccessorImpl.java:45)
> > > at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> > > at org.apache.fluo.api.client.FluoFactory.buildClassWithConfig(
> > > FluoFactory.java:117)
> > > ... 37 more
> > > Caused by: java.lang.IllegalStateException:
> > java.lang.IllegalStateException:
> > > org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode
> =
> > > NoNode for /config/accumulo.instance.name
> > > at org.apache.fluo.core.client.FluoClientImpl.<init>(
> > > FluoClientImpl.java:62)
> > > ... 42 more
> > > Caused by: java.lang.IllegalStateException: org.apache.zookeeper.
> > > KeeperException$NoNodeException: KeeperErrorCode = NoNode for /config/
> > > accumulo.instance.name
> > > at org.apache.fluo.core.impl.Environment.readZookeeperConfig(
> > > Environment.java:163)
> > > at org.apache.fluo.core.impl.Environment.<init>(Environment.java:78)
> > > at org.apache.fluo.core.client.FluoClientImpl.<init>(
> > > FluoClientImpl.java:60)
> > > ... 42 more
> > > Caused by: org.apache.zookeeper.KeeperException$NoNodeException:
> > > KeeperErrorCode = NoNode for /config/accumulo.instance.name
> > > at org.apache.zookeeper.KeeperException.create(
> KeeperException.java:111)
> > > at org.apache.zookeeper.KeeperException.create(
> KeeperException.java:51)
> > > at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
> > > at org.apache.curator.framework.imps.GetDataBuilderImpl$4.
> > > call(GetDataBuilderImpl.java:302)
> > > at org.apache.curator.framework.imps.GetDataBuilderImpl$4.
> > > call(GetDataBuilderImpl.java:291)
> > > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
> > > at org.apache.curator.framework.imps.GetDataBuilderImpl.
> pathInForeground(
> > > GetDataBuilderImpl.java:288)
> > > at org.apache.curator.framework.imps.GetDataBuilderImpl.
> > > forPath(GetDataBuilderImpl.java:279)
> > > at org.apache.curator.framework.imps.GetDataBuilderImpl.
> > > forPath(GetDataBuilderImpl.java:41)
> > > at org.apache.fluo.core.impl.Environment.readZookeeperConfig(
> > > Environment.java:126)
> > > ... 44 more
> > >
> > >
> > > I see the following error every once in awhile. I could definitely see
> > > this one being an environment issue of some sort. I haven't taken the
> > time
> > > to track down the error in the tablet server logs yet.
> > >
> > > org.apache.rya.api.client.RyaClientException: The RyaDetails couldn't
> be
> > > initialized. Details: Could not initialize the Rya instance details for
> > the
> > > instance named 'test_'.
> > >
> > > at org.apache.rya.api.client.accumulo.AccumuloInstall.
> > > install(AccumuloInstall.java:98)
> > > at org.apache.rya.api.client.accumulo.FluoITBase.setupRya(
> > > FluoITBase.java:303)
> > > at org.apache.rya.api.client.accumulo.FluoITBase.
> > > setupMiniResources(FluoITBase.java:126)
> > > ...
> > > Caused by:
> > org.apache.rya.api.instance.RyaDetailsRepository$
> RyaDetailsRepositoryException:
> > > Could not initialize the Rya instance details for the instance named
> > > 'test_'.
> > > at org.apache.rya.accumulo.instance.AccumuloRyaInstanceDetailsRepo
> > > sitory.initialize(AccumuloRyaInstanceDetailsRepository.java:150)
> > > at org.apache.rya.api.client.accumulo.AccumuloInstall.
> > > initializeRyaDetails(AccumuloInstall.java:173)
> > > at org.apache.rya.api.client.accumulo.AccumuloInstall.
> > > install(AccumuloInstall.java:92)
> > > ... 34 more
> > > Caused by: org.apache.accumulo.core.client.MutationsRejectedException:
> #
> > > constraint violations : 0 security codes: {} # server errors 1 #
> > > exceptions 0
> > > at org.apache.accumulo.core.client.impl.TabletServerBatchWriter.
> > > checkForFailures(TabletServerBatchWriter.java:537)
> > > at org.apache.accumulo.core.client.impl.TabletServerBatchWriter.close(
> > > TabletServerBatchWriter.java:354)
> > > at org.apache.accumulo.core.client.impl.BatchWriterImpl.
> > > close(BatchWriterImpl.java:54)
> > > at org.apache.rya.accumulo.instance.AccumuloRyaInstanceDetailsRepo
> > > sitory.initialize(AccumuloRyaInstanceDetailsRepository.java:148)
> > > ... 36 more
> > >
> > >
> > >
> > > On Fri, May 5, 2017 at 11:43 AM, Aaron D. Mihalik <
> > aaron.mihalik@gmail.com
> > > > wrote:
> > >
> > >> I checked jenkins [1] and the latest builds are in sync with the
> master
> > >> branch. I'm rebuilding rya locally to double check.
> > >>
> > >> Jonathan: Can you provide some more details? windows/linux? with the
> > >> Geoindexing profile enabled/disabled? Also some junit stack traces
> > would
> > >> be nice, too :)
> > >>
> > >> Thanks,
> > >> Aaron
> > >>
> > >> [1] For reference, the build server is is at
> https://builds.apache.org
> > >>
> > >> On Fri, May 5, 2017 at 8:25 AM Puja Valiyil <pu...@gmail.com>
> wrote:
> > >>
> > >> > It's an environment issue-- Apache Jenkins servers build master
> > >> following
> > >> > any commit and there hasn't been any emails saying the build is
> > failing.
> > >> > It's possible that the github mirror issues earlier this week made
> it
> > so
> > >> > commits occurred but weren't picked up by Jenkins maybe, so someone
> > >> should
> > >> > probably double check the build.
> > >> >
> > >> > On Friday, May 5, 2017, Jonathan Wonders <jw...@gmail.com>
> > wrote:
> > >> >
> > >> > > I'm seeing some integration test failures in the indexing project
> on
> > >> the
> > >> > > master branch. Are these expected or could it be an environment
> > >> issue?
> > >> > If
> > >> > > these are known/expected it might be a good idea to ignore them
> and
> > >> > > reference an issue number so its clear why they are disabled.
> > >> > >
> > >> > > - AccumuloGetInstanceDetailsIT
> > >> > > - AccumuloUninstallIT
> > >> > > - AccumuloLoadStatementsFileIT
> > >> > > - PrecompJoinOptimizerIntegrationTest
> > >> > > - PrecompJoinOptimizerTest2
> > >> > >
> > >> > >
> > >> > >
> > >> > > On Thu, May 4, 2017 at 8:09 PM, Puja Valiyil <pujav65@gmail.com
> > >> > > <javascript:;>> wrote:
> > >> > >
> > >> > > > There aren't any critical bug fixes, so now is just as good a
> time
> > >> as
> > >> > > any.
> > >> > > >
> > >> > > > Sent from my iPhone
> > >> > > >
> > >> > > > > On May 4, 2017, at 5:20 PM, Aaron D. Mihalik <
> > >> > aaron.mihalik@gmail.com
> > >> > > <javascript:;>>
> > >> > > > wrote:
> > >> > > > >
> > >> > > > > Yeah, I'll take another shot at it and iron out the process a
> > bit
> > >> > more
> > >> > > :)
> > >> > > > >
> > >> > > > > However, I won't have time until next week. Are there any
> > >> specific
> > >> > PRs
> > >> > > > > that we should wait on?
> > >> > > > >
> > >> > > > > --Aaron
> > >> > > > >
> > >> > > > >> On Thu, May 4, 2017 at 4:23 PM Adina Crainiceanu <
> > adina@usna.edu
> > >> > > <javascript:;>>
> > >> > > > wrote:
> > >> > > > >>
> > >> > > > >> Aaron, do you think we can try another release with you as
> the
> > >> > release
> > >> > > > >> manager? I volunteer to be the release manager next time.
> > >> > > > >>
> > >> > > > >> Thanks,
> > >> > > > >> Adina
> > >> > > > >>
> > >> > > > >> On Mon, Apr 3, 2017 at 1:47 PM, Aaron D. Mihalik <
> > >> > > > aaron.mihalik@gmail.com <javascript:;>>
> > >> > > > >> wrote:
> > >> > > > >>
> > >> > > > >>> Hey Adina,
> > >> > > > >>>
> > >> > > > >>> I think this is a good idea. Thanks for sending this out
> and
> > >> > getting
> > >> > > > the
> > >> > > > >>> process started.
> > >> > > > >>>
> > >> > > > >>> I'm able to support another release, but I think it would be
> > >> more
> > >> > > > useful
> > >> > > > >> if
> > >> > > > >>> someone else was the release manager. I'm available to work
> > >> with a
> > >> > > > >>> committer to get ready for the release and to update the
> > release
> > >> > > > >>> documentation (which is mostly notes, not an actual process
> > >> right
> > >> > > now).
> > >> > > > >>>
> > >> > > > >>> --Aaron
> > >> > > > >>>
> > >> > > > >>>
> > >> > > > >>>
> > >> > > > >>> On Mon, Apr 3, 2017 at 11:43 AM Adina Crainiceanu <
> > >> adina@usna.edu
> > >> > > <javascript:;>>
> > >> > > > >> wrote:
> > >> > > > >>>
> > >> > > > >>>> Hi,
> > >> > > > >>>>
> > >> > > > >>>> I wanted to start a discussion about the next release of
> Rya.
> > >> We
> > >> > had
> > >> > > > >> one
> > >> > > > >>>> release as part of ASF in October. It would be good to have
> > >> more
> > >> > > > >> frequent
> > >> > > > >>>> releases, so we can learn how to do releases, as a step
> > towards
> > >> > > > >>> graduation
> > >> > > > >>>> from the Incubator.
> > >> > > > >>>>
> > >> > > > >>>> Let me know what you think.
> > >> > > > >>>> Thanks,
> > >> > > > >>>> Adina
> > >> > > > >>>>
> > >> > > > >>>> --
> > >> > > > >>>> Dr. Adina Crainiceanu
> > >> > > > >>>> Associate Professor, Computer Science Department
> > >> > > > >>>> United States Naval Academy
> > >> > > > >>>> 410-293-6822 <(410)%20293-6822> <(410)%20293-6822>
> > <(410)%20293-6822>
> > >> > <(410)%20293-6822>
> > >> > > > >>>> adina@usna.edu <javascript:;>
> > >> > > > >>>> http://www.usna.edu/Users/cs/adina/
> > >> > > > >>>>
> > >> > > > >>>
> > >> > > > >>
> > >> > > > >>
> > >> > > > >>
> > >> > > > >> --
> > >> > > > >> Dr. Adina Crainiceanu
> > >> > > > >> Associate Professor, Computer Science Department
> > >> > > > >> United States Naval Academy
> > >> > > > >> 410-293-6822 <(410)%20293-6822> <(410)%20293-6822>
> > <(410)%20293-6822>
> > >> > > > >> adina@usna.edu <javascript:;>
> > >> > > > >> http://www.usna.edu/Users/cs/adina/
> > >> > > > >>
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>
--
Dr. Adina Crainiceanu
Associate Professor, Computer Science Department
United States Naval Academy
410-293-6822
adina@usna.edu
http://www.usna.edu/Users/cs/adina/
Re: next release of Rya?
Posted by Adina Crainiceanu <ad...@usna.edu>.
Great David, thank you very much for volunteering.
I gave you karma for the wiki. Happy updating!
Thanks,
Adina
On Wed, Aug 16, 2017 at 1:06 PM, David Lotts <dl...@gmail.com> wrote:
> I'll volunteer to manage the release this time.
> I'll get started late this week or Monday.
>
> Does anybody know how to get edit karma for our wiki?
> I have some updates to:
> https://cwiki.apache.org/confluence/display/RYA/Contributing+to+Rya
>
> david.
>
--
Dr. Adina Crainiceanu
Associate Professor, Computer Science Department
United States Naval Academy
410-293-6822
adina@usna.edu
http://www.usna.edu/Users/cs/adina/
Re: next release of Rya?
Posted by David Lotts <dl...@gmail.com>.
I'll volunteer to manage the release this time.
I'll get started late this week or Monday.
Does anybody know how to get edit karma for our wiki?
I have some updates to:
https://cwiki.apache.org/confluence/display/RYA/Contributing+to+Rya
david.