You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by John Vines <vi...@apache.org> on 2013/04/17 00:29:50 UTC
VFS class reloading?
Maybe I missed something with the switch to the VFS classloader, but does
dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
threw an iterator in there, but had to restart tserver to get the new
iterator picked up. Was that an intentional change?
Re: VFS class reloading?
Posted by John Vines <vi...@apache.org>.
Tested again, reloading seems to be working fine. Unsure what was going on
before.
On Wed, Apr 17, 2013 at 10:15 AM, John Vines <vi...@apache.org> wrote:
> The issue wasn't that it wasn't picking up jars in there, it wasn't
> dynamically loading them. I'll test again for sanity's sake.
>
>
> On Tue, Apr 16, 2013 at 8:57 PM, <dl...@comcast.net> wrote:
>
>> I was able to confirm that 'accumulo classpath' picked up jars in
>> lib/ext. So it's configured to know about that location.
>>
>> ----- Original Message -----
>> From: "Eric Newton" <er...@gmail.com>
>> To: dev@accumulo.apache.org
>> Sent: Tuesday, April 16, 2013 7:52:09 PM
>> Subject: Re: VFS class reloading?
>>
>> We have tests for dynamic loading of classes so I'm pretty sure it works.
>>
>> John, can you repeat the failure?
>>
>> -Eric
>>
>>
>>
>> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net>
>> wrote:
>>
>> > Looking at the code, it should work. Keith and I had several
>> conversations
>> > about what the new classloader should do. I believe that he wanted it to
>> > behave like the old one and what I see in the code supports that. If it
>> is
>> > not working, then I would say create a ticket for it for now. I'll try
>> to
>> > replicate it tonight if I have time.
>> >
>> > -----Original Message-----
>> > From: Dave Marion [mailto:dlmarion@comcast.net]
>> > Sent: Tuesday, April 16, 2013 6:41 PM
>> > To: dev@accumulo.apache.org
>> > Subject: RE: VFS class reloading?
>> >
>> > The implementation changed several times, so the pre-1.5 layout may not
>> > work. In 1.5, using the bootstrap script, it should put the accumulo
>> jars
>> > into HDFS and dynamic loading from there should occur. I'll try and test
>> > tonight if I have time.
>> >
>> > -----Original Message-----
>> > From: John Vines [mailto:vines@apache.org]
>> > Sent: Tuesday, April 16, 2013 6:30 PM
>> > To: Accumulo Dev List
>> > Subject: VFS class reloading?
>> >
>> > Maybe I missed something with the switch to the VFS classloader, but
>> does
>> > dynamic loading out of lib/ext no longer work? I had accumulo 1.5
>> running,
>> > threw an iterator in there, but had to restart tserver to get the new
>> > iterator picked up. Was that an intentional change?
>> >
>> >
>>
>
>
Re: VFS class reloading?
Posted by John Vines <vi...@apache.org>.
The issue wasn't that it wasn't picking up jars in there, it wasn't
dynamically loading them. I'll test again for sanity's sake.
On Tue, Apr 16, 2013 at 8:57 PM, <dl...@comcast.net> wrote:
> I was able to confirm that 'accumulo classpath' picked up jars in lib/ext.
> So it's configured to know about that location.
>
> ----- Original Message -----
> From: "Eric Newton" <er...@gmail.com>
> To: dev@accumulo.apache.org
> Sent: Tuesday, April 16, 2013 7:52:09 PM
> Subject: Re: VFS class reloading?
>
> We have tests for dynamic loading of classes so I'm pretty sure it works.
>
> John, can you repeat the failure?
>
> -Eric
>
>
>
> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
>
> > Looking at the code, it should work. Keith and I had several
> conversations
> > about what the new classloader should do. I believe that he wanted it to
> > behave like the old one and what I see in the code supports that. If it
> is
> > not working, then I would say create a ticket for it for now. I'll try to
> > replicate it tonight if I have time.
> >
> > -----Original Message-----
> > From: Dave Marion [mailto:dlmarion@comcast.net]
> > Sent: Tuesday, April 16, 2013 6:41 PM
> > To: dev@accumulo.apache.org
> > Subject: RE: VFS class reloading?
> >
> > The implementation changed several times, so the pre-1.5 layout may not
> > work. In 1.5, using the bootstrap script, it should put the accumulo jars
> > into HDFS and dynamic loading from there should occur. I'll try and test
> > tonight if I have time.
> >
> > -----Original Message-----
> > From: John Vines [mailto:vines@apache.org]
> > Sent: Tuesday, April 16, 2013 6:30 PM
> > To: Accumulo Dev List
> > Subject: VFS class reloading?
> >
> > Maybe I missed something with the switch to the VFS classloader, but does
> > dynamic loading out of lib/ext no longer work? I had accumulo 1.5
> running,
> > threw an iterator in there, but had to restart tserver to get the new
> > iterator picked up. Was that an intentional change?
> >
> >
>
Re: VFS class reloading?
Posted by Billie Rinaldi <bi...@gmail.com>.
On Wed, Apr 17, 2013 at 9:20 AM, Josh Elser <jo...@gmail.com> wrote:
> Actually, I think I may renege for a couple of points:
>
> 1) This is really a minimal change on us to support 0.20.x-based Hadoop
> versions. The patch (or something similar) I made last night and then also
> figuring out the correct commons-io jar to add to that patch.
>
> 2) I re-read Dave's email and noted that he was saying CDH3 is still based
> off of 0.20.x, so that makes the affected community much larger than Apache
> Hadoop 0.20.x.
>
> John Vines, reading back through ACCUMULO-1244:
>
> For the record, this breaks compatibility for releases at least at and
> before hadoop-1.0.1.
>
> Do we just need to set the commons-io dependency back to 1.4 for
> <Hadoop-1.0.1? Is 1.5 now dependent on new functionality that is only in
> >commons-io-1.4? Is there a way that we can try to smooth the fracturing of
> Hadoop distributions without being overbearing on Accumulo?
We should probably make commons-io version a pom variable, then people can
pass in the version that goes with the hadoop they're compiling against. I
propose leaving the default as is, and people can override it if they need
1.4.
Billie
>
>
> On 4/16/13 10:08 PM, Josh Elser wrote:
>
>> I think I'm ok with dropping 0.20.205.0 support, but, as Dave pointed
>> out, we need to update the README to reflect such (really needs to happen
>> before 1.5.0 drops).
>>
>> I'll drop a poll to see if anyone who's only subscribed to user@a.a.ohas any concerns on the matter.
>>
>> On 04/16/2013 09:59 PM, Billie Rinaldi wrote:
>>
>>> On Tue, Apr 16, 2013 at 5:39 PM, <dl...@comcast.net> wrote:
>>>
>>> Updated my local 1.5 branch and tried to build with "mvn clean package
>>>> -P
>>>> assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3
>>>> locally,
>>>> so that should work. A bunch of tests failed in core with:
>>>>
>>>> Caused by: java.lang.**ClassNotFoundException:
>>>> org.codehaus.jackson.map.**JsonMappingException
>>>> at java.net.URLClassLoader$1.run(**URLClassLoader.java:202)
>>>> at java.security.**AccessController.doPrivileged(**Native Method)
>>>> at java.net.URLClassLoader.**findClass(URLClassLoader.java:**190)
>>>> at java.lang.ClassLoader.**loadClass(ClassLoader.java:**306)
>>>> at sun.misc.Launcher$**AppClassLoader.loadClass(**Launcher.java:301)
>>>> at java.lang.ClassLoader.**loadClass(ClassLoader.java:**247)
>>>>
>>>>
>>>> Has anyone else seen this?
>>>>
>>>> Yep, I broke that in ACCUMULO-730. See the first comment where I ask
>>> if
>>> anyone still needs 0.20.205.0 and what we should do to fix it if they do.
>>> It's not too late to weigh in.
>>>
>>> Billie
>>>
>>>
>>>
>>> -- Dave
>>>>
>>>> ----- Original Message -----
>>>> From: "Eric Newton" <er...@gmail.com>
>>>> To: dev@accumulo.apache.org
>>>> Sent: Tuesday, April 16, 2013 7:52:09 PM
>>>> Subject: Re: VFS class reloading?
>>>>
>>>> We have tests for dynamic loading of classes so I'm pretty sure it
>>>> works.
>>>>
>>>> John, can you repeat the failure?
>>>>
>>>> -Eric
>>>>
>>>>
>>>>
>>>> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net>
>>>> wrote:
>>>>
>>>> Looking at the code, it should work. Keith and I had several
>>>>>
>>>> conversations
>>>>
>>>>> about what the new classloader should do. I believe that he wanted it
>>>>> to
>>>>> behave like the old one and what I see in the code supports that. If it
>>>>>
>>>> is
>>>>
>>>>> not working, then I would say create a ticket for it for now. I'll try
>>>>> to
>>>>> replicate it tonight if I have time.
>>>>>
>>>>> -----Original Message-----
>>>>> From: Dave Marion [mailto:dlmarion@comcast.net]
>>>>> Sent: Tuesday, April 16, 2013 6:41 PM
>>>>> To: dev@accumulo.apache.org
>>>>> Subject: RE: VFS class reloading?
>>>>>
>>>>> The implementation changed several times, so the pre-1.5 layout may not
>>>>> work. In 1.5, using the bootstrap script, it should put the accumulo
>>>>> jars
>>>>> into HDFS and dynamic loading from there should occur. I'll try and
>>>>> test
>>>>> tonight if I have time.
>>>>>
>>>>> -----Original Message-----
>>>>> From: John Vines [mailto:vines@apache.org]
>>>>> Sent: Tuesday, April 16, 2013 6:30 PM
>>>>> To: Accumulo Dev List
>>>>> Subject: VFS class reloading?
>>>>>
>>>>> Maybe I missed something with the switch to the VFS classloader, but
>>>>> does
>>>>> dynamic loading out of lib/ext no longer work? I had accumulo 1.5
>>>>>
>>>> running,
>>>>
>>>>> threw an iterator in there, but had to restart tserver to get the new
>>>>> iterator picked up. Was that an intentional change?
>>>>>
>>>>>
>>>>>
>>
>
Re: VFS class reloading?
Posted by Billie Rinaldi <bi...@gmail.com>.
On Wed, Apr 17, 2013 at 9:43 AM, John Vines <vi...@apache.org> wrote:
> The issue is hadoop 1.0.1 and earlier do not have commons-io at all. So
> there is no jar to pick up on the classpath. So when we made commons-io
> provided, we lost the jar for the previous releases.
>
Ah, I see. So no version variable is required, we just need to do
something about the provided scope.
Billie
>
>
> On Wed, Apr 17, 2013 at 12:20 PM, Josh Elser <jo...@gmail.com> wrote:
>
> > Actually, I think I may renege for a couple of points:
> >
> > 1) This is really a minimal change on us to support 0.20.x-based Hadoop
> > versions. The patch (or something similar) I made last night and then
> also
> > figuring out the correct commons-io jar to add to that patch.
> >
> > 2) I re-read Dave's email and noted that he was saying CDH3 is still
> based
> > off of 0.20.x, so that makes the affected community much larger than
> Apache
> > Hadoop 0.20.x.
> >
> > John Vines, reading back through ACCUMULO-1244:
> >
> > For the record, this breaks compatibility for releases at least at and
> > before hadoop-1.0.1.
> >
> > Do we just need to set the commons-io dependency back to 1.4 for
> > <Hadoop-1.0.1? Is 1.5 now dependent on new functionality that is only in
> > >commons-io-1.4? Is there a way that we can try to smooth the fracturing
> of
> > Hadoop distributions without being overbearing on Accumulo?
> >
> >
> > On 4/16/13 10:08 PM, Josh Elser wrote:
> >
> >> I think I'm ok with dropping 0.20.205.0 support, but, as Dave pointed
> >> out, we need to update the README to reflect such (really needs to
> happen
> >> before 1.5.0 drops).
> >>
> >> I'll drop a poll to see if anyone who's only subscribed to user@a.a.ohasany concerns on the matter.
> >>
> >> On 04/16/2013 09:59 PM, Billie Rinaldi wrote:
> >>
> >>> On Tue, Apr 16, 2013 at 5:39 PM, <dl...@comcast.net> wrote:
> >>>
> >>> Updated my local 1.5 branch and tried to build with "mvn clean package
> >>>> -P
> >>>> assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3
> >>>> locally,
> >>>> so that should work. A bunch of tests failed in core with:
> >>>>
> >>>> Caused by: java.lang.**ClassNotFoundException:
> >>>> org.codehaus.jackson.map.**JsonMappingException
> >>>> at java.net.URLClassLoader$1.run(**URLClassLoader.java:202)
> >>>> at java.security.**AccessController.doPrivileged(**Native Method)
> >>>> at java.net.URLClassLoader.**findClass(URLClassLoader.java:**190)
> >>>> at java.lang.ClassLoader.**loadClass(ClassLoader.java:**306)
> >>>> at sun.misc.Launcher$**AppClassLoader.loadClass(**Launcher.java:301)
> >>>> at java.lang.ClassLoader.**loadClass(ClassLoader.java:**247)
> >>>>
> >>>>
> >>>> Has anyone else seen this?
> >>>>
> >>>> Yep, I broke that in ACCUMULO-730. See the first comment where I ask
> >>> if
> >>> anyone still needs 0.20.205.0 and what we should do to fix it if they
> do.
> >>> It's not too late to weigh in.
> >>>
> >>> Billie
> >>>
> >>>
> >>>
> >>> -- Dave
> >>>>
> >>>> ----- Original Message -----
> >>>> From: "Eric Newton" <er...@gmail.com>
> >>>> To: dev@accumulo.apache.org
> >>>> Sent: Tuesday, April 16, 2013 7:52:09 PM
> >>>> Subject: Re: VFS class reloading?
> >>>>
> >>>> We have tests for dynamic loading of classes so I'm pretty sure it
> >>>> works.
> >>>>
> >>>> John, can you repeat the failure?
> >>>>
> >>>> -Eric
> >>>>
> >>>>
> >>>>
> >>>> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net>
> >>>> wrote:
> >>>>
> >>>> Looking at the code, it should work. Keith and I had several
> >>>>>
> >>>> conversations
> >>>>
> >>>>> about what the new classloader should do. I believe that he wanted it
> >>>>> to
> >>>>> behave like the old one and what I see in the code supports that. If
> it
> >>>>>
> >>>> is
> >>>>
> >>>>> not working, then I would say create a ticket for it for now. I'll
> try
> >>>>> to
> >>>>> replicate it tonight if I have time.
> >>>>>
> >>>>> -----Original Message-----
> >>>>> From: Dave Marion [mailto:dlmarion@comcast.net]
> >>>>> Sent: Tuesday, April 16, 2013 6:41 PM
> >>>>> To: dev@accumulo.apache.org
> >>>>> Subject: RE: VFS class reloading?
> >>>>>
> >>>>> The implementation changed several times, so the pre-1.5 layout may
> not
> >>>>> work. In 1.5, using the bootstrap script, it should put the accumulo
> >>>>> jars
> >>>>> into HDFS and dynamic loading from there should occur. I'll try and
> >>>>> test
> >>>>> tonight if I have time.
> >>>>>
> >>>>> -----Original Message-----
> >>>>> From: John Vines [mailto:vines@apache.org]
> >>>>> Sent: Tuesday, April 16, 2013 6:30 PM
> >>>>> To: Accumulo Dev List
> >>>>> Subject: VFS class reloading?
> >>>>>
> >>>>> Maybe I missed something with the switch to the VFS classloader, but
> >>>>> does
> >>>>> dynamic loading out of lib/ext no longer work? I had accumulo 1.5
> >>>>>
> >>>> running,
> >>>>
> >>>>> threw an iterator in there, but had to restart tserver to get the new
> >>>>> iterator picked up. Was that an intentional change?
> >>>>>
> >>>>>
> >>>>>
> >>
> >
>
Re: VFS class reloading?
Posted by John Vines <vi...@apache.org>.
The issue is hadoop 1.0.1 and earlier do not have commons-io at all. So
there is no jar to pick up on the classpath. So when we made commons-io
provided, we lost the jar for the previous releases.
On Wed, Apr 17, 2013 at 12:20 PM, Josh Elser <jo...@gmail.com> wrote:
> Actually, I think I may renege for a couple of points:
>
> 1) This is really a minimal change on us to support 0.20.x-based Hadoop
> versions. The patch (or something similar) I made last night and then also
> figuring out the correct commons-io jar to add to that patch.
>
> 2) I re-read Dave's email and noted that he was saying CDH3 is still based
> off of 0.20.x, so that makes the affected community much larger than Apache
> Hadoop 0.20.x.
>
> John Vines, reading back through ACCUMULO-1244:
>
> For the record, this breaks compatibility for releases at least at and
> before hadoop-1.0.1.
>
> Do we just need to set the commons-io dependency back to 1.4 for
> <Hadoop-1.0.1? Is 1.5 now dependent on new functionality that is only in
> >commons-io-1.4? Is there a way that we can try to smooth the fracturing of
> Hadoop distributions without being overbearing on Accumulo?
>
>
> On 4/16/13 10:08 PM, Josh Elser wrote:
>
>> I think I'm ok with dropping 0.20.205.0 support, but, as Dave pointed
>> out, we need to update the README to reflect such (really needs to happen
>> before 1.5.0 drops).
>>
>> I'll drop a poll to see if anyone who's only subscribed to user@a.a.ohas any concerns on the matter.
>>
>> On 04/16/2013 09:59 PM, Billie Rinaldi wrote:
>>
>>> On Tue, Apr 16, 2013 at 5:39 PM, <dl...@comcast.net> wrote:
>>>
>>> Updated my local 1.5 branch and tried to build with "mvn clean package
>>>> -P
>>>> assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3
>>>> locally,
>>>> so that should work. A bunch of tests failed in core with:
>>>>
>>>> Caused by: java.lang.**ClassNotFoundException:
>>>> org.codehaus.jackson.map.**JsonMappingException
>>>> at java.net.URLClassLoader$1.run(**URLClassLoader.java:202)
>>>> at java.security.**AccessController.doPrivileged(**Native Method)
>>>> at java.net.URLClassLoader.**findClass(URLClassLoader.java:**190)
>>>> at java.lang.ClassLoader.**loadClass(ClassLoader.java:**306)
>>>> at sun.misc.Launcher$**AppClassLoader.loadClass(**Launcher.java:301)
>>>> at java.lang.ClassLoader.**loadClass(ClassLoader.java:**247)
>>>>
>>>>
>>>> Has anyone else seen this?
>>>>
>>>> Yep, I broke that in ACCUMULO-730. See the first comment where I ask
>>> if
>>> anyone still needs 0.20.205.0 and what we should do to fix it if they do.
>>> It's not too late to weigh in.
>>>
>>> Billie
>>>
>>>
>>>
>>> -- Dave
>>>>
>>>> ----- Original Message -----
>>>> From: "Eric Newton" <er...@gmail.com>
>>>> To: dev@accumulo.apache.org
>>>> Sent: Tuesday, April 16, 2013 7:52:09 PM
>>>> Subject: Re: VFS class reloading?
>>>>
>>>> We have tests for dynamic loading of classes so I'm pretty sure it
>>>> works.
>>>>
>>>> John, can you repeat the failure?
>>>>
>>>> -Eric
>>>>
>>>>
>>>>
>>>> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net>
>>>> wrote:
>>>>
>>>> Looking at the code, it should work. Keith and I had several
>>>>>
>>>> conversations
>>>>
>>>>> about what the new classloader should do. I believe that he wanted it
>>>>> to
>>>>> behave like the old one and what I see in the code supports that. If it
>>>>>
>>>> is
>>>>
>>>>> not working, then I would say create a ticket for it for now. I'll try
>>>>> to
>>>>> replicate it tonight if I have time.
>>>>>
>>>>> -----Original Message-----
>>>>> From: Dave Marion [mailto:dlmarion@comcast.net]
>>>>> Sent: Tuesday, April 16, 2013 6:41 PM
>>>>> To: dev@accumulo.apache.org
>>>>> Subject: RE: VFS class reloading?
>>>>>
>>>>> The implementation changed several times, so the pre-1.5 layout may not
>>>>> work. In 1.5, using the bootstrap script, it should put the accumulo
>>>>> jars
>>>>> into HDFS and dynamic loading from there should occur. I'll try and
>>>>> test
>>>>> tonight if I have time.
>>>>>
>>>>> -----Original Message-----
>>>>> From: John Vines [mailto:vines@apache.org]
>>>>> Sent: Tuesday, April 16, 2013 6:30 PM
>>>>> To: Accumulo Dev List
>>>>> Subject: VFS class reloading?
>>>>>
>>>>> Maybe I missed something with the switch to the VFS classloader, but
>>>>> does
>>>>> dynamic loading out of lib/ext no longer work? I had accumulo 1.5
>>>>>
>>>> running,
>>>>
>>>>> threw an iterator in there, but had to restart tserver to get the new
>>>>> iterator picked up. Was that an intentional change?
>>>>>
>>>>>
>>>>>
>>
>
Re: VFS class reloading?
Posted by Josh Elser <jo...@gmail.com>.
Actually, I think I may renege for a couple of points:
1) This is really a minimal change on us to support 0.20.x-based Hadoop
versions. The patch (or something similar) I made last night and then
also figuring out the correct commons-io jar to add to that patch.
2) I re-read Dave's email and noted that he was saying CDH3 is still
based off of 0.20.x, so that makes the affected community much larger
than Apache Hadoop 0.20.x.
John Vines, reading back through ACCUMULO-1244:
For the record, this breaks compatibility for releases at least at and before hadoop-1.0.1.
Do we just need to set the commons-io dependency back to 1.4 for
<Hadoop-1.0.1? Is 1.5 now dependent on new functionality that is only in
>commons-io-1.4? Is there a way that we can try to smooth the
fracturing of Hadoop distributions without being overbearing on Accumulo?
On 4/16/13 10:08 PM, Josh Elser wrote:
> I think I'm ok with dropping 0.20.205.0 support, but, as Dave pointed
> out, we need to update the README to reflect such (really needs to
> happen before 1.5.0 drops).
>
> I'll drop a poll to see if anyone who's only subscribed to user@a.a.o
> has any concerns on the matter.
>
> On 04/16/2013 09:59 PM, Billie Rinaldi wrote:
>> On Tue, Apr 16, 2013 at 5:39 PM, <dl...@comcast.net> wrote:
>>
>>> Updated my local 1.5 branch and tried to build with "mvn clean
>>> package -P
>>> assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3
>>> locally,
>>> so that should work. A bunch of tests failed in core with:
>>>
>>> Caused by: java.lang.ClassNotFoundException:
>>> org.codehaus.jackson.map.JsonMappingException
>>> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>>>
>>>
>>> Has anyone else seen this?
>>>
>> Yep, I broke that in ACCUMULO-730. See the first comment where I ask if
>> anyone still needs 0.20.205.0 and what we should do to fix it if they
>> do.
>> It's not too late to weigh in.
>>
>> Billie
>>
>>
>>
>>> -- Dave
>>>
>>> ----- Original Message -----
>>> From: "Eric Newton" <er...@gmail.com>
>>> To: dev@accumulo.apache.org
>>> Sent: Tuesday, April 16, 2013 7:52:09 PM
>>> Subject: Re: VFS class reloading?
>>>
>>> We have tests for dynamic loading of classes so I'm pretty sure it
>>> works.
>>>
>>> John, can you repeat the failure?
>>>
>>> -Eric
>>>
>>>
>>>
>>> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net>
>>> wrote:
>>>
>>>> Looking at the code, it should work. Keith and I had several
>>> conversations
>>>> about what the new classloader should do. I believe that he wanted
>>>> it to
>>>> behave like the old one and what I see in the code supports that.
>>>> If it
>>> is
>>>> not working, then I would say create a ticket for it for now. I'll
>>>> try to
>>>> replicate it tonight if I have time.
>>>>
>>>> -----Original Message-----
>>>> From: Dave Marion [mailto:dlmarion@comcast.net]
>>>> Sent: Tuesday, April 16, 2013 6:41 PM
>>>> To: dev@accumulo.apache.org
>>>> Subject: RE: VFS class reloading?
>>>>
>>>> The implementation changed several times, so the pre-1.5 layout may
>>>> not
>>>> work. In 1.5, using the bootstrap script, it should put the
>>>> accumulo jars
>>>> into HDFS and dynamic loading from there should occur. I'll try and
>>>> test
>>>> tonight if I have time.
>>>>
>>>> -----Original Message-----
>>>> From: John Vines [mailto:vines@apache.org]
>>>> Sent: Tuesday, April 16, 2013 6:30 PM
>>>> To: Accumulo Dev List
>>>> Subject: VFS class reloading?
>>>>
>>>> Maybe I missed something with the switch to the VFS classloader,
>>>> but does
>>>> dynamic loading out of lib/ext no longer work? I had accumulo 1.5
>>> running,
>>>> threw an iterator in there, but had to restart tserver to get the new
>>>> iterator picked up. Was that an intentional change?
>>>>
>>>>
>
Re: VFS class reloading?
Posted by Josh Elser <jo...@gmail.com>.
I think I'm ok with dropping 0.20.205.0 support, but, as Dave pointed
out, we need to update the README to reflect such (really needs to
happen before 1.5.0 drops).
I'll drop a poll to see if anyone who's only subscribed to user@a.a.o
has any concerns on the matter.
On 04/16/2013 09:59 PM, Billie Rinaldi wrote:
> On Tue, Apr 16, 2013 at 5:39 PM, <dl...@comcast.net> wrote:
>
>> Updated my local 1.5 branch and tried to build with "mvn clean package -P
>> assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3 locally,
>> so that should work. A bunch of tests failed in core with:
>>
>> Caused by: java.lang.ClassNotFoundException:
>> org.codehaus.jackson.map.JsonMappingException
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>>
>>
>> Has anyone else seen this?
>>
> Yep, I broke that in ACCUMULO-730. See the first comment where I ask if
> anyone still needs 0.20.205.0 and what we should do to fix it if they do.
> It's not too late to weigh in.
>
> Billie
>
>
>
>> -- Dave
>>
>> ----- Original Message -----
>> From: "Eric Newton" <er...@gmail.com>
>> To: dev@accumulo.apache.org
>> Sent: Tuesday, April 16, 2013 7:52:09 PM
>> Subject: Re: VFS class reloading?
>>
>> We have tests for dynamic loading of classes so I'm pretty sure it works.
>>
>> John, can you repeat the failure?
>>
>> -Eric
>>
>>
>>
>> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
>>
>>> Looking at the code, it should work. Keith and I had several
>> conversations
>>> about what the new classloader should do. I believe that he wanted it to
>>> behave like the old one and what I see in the code supports that. If it
>> is
>>> not working, then I would say create a ticket for it for now. I'll try to
>>> replicate it tonight if I have time.
>>>
>>> -----Original Message-----
>>> From: Dave Marion [mailto:dlmarion@comcast.net]
>>> Sent: Tuesday, April 16, 2013 6:41 PM
>>> To: dev@accumulo.apache.org
>>> Subject: RE: VFS class reloading?
>>>
>>> The implementation changed several times, so the pre-1.5 layout may not
>>> work. In 1.5, using the bootstrap script, it should put the accumulo jars
>>> into HDFS and dynamic loading from there should occur. I'll try and test
>>> tonight if I have time.
>>>
>>> -----Original Message-----
>>> From: John Vines [mailto:vines@apache.org]
>>> Sent: Tuesday, April 16, 2013 6:30 PM
>>> To: Accumulo Dev List
>>> Subject: VFS class reloading?
>>>
>>> Maybe I missed something with the switch to the VFS classloader, but does
>>> dynamic loading out of lib/ext no longer work? I had accumulo 1.5
>> running,
>>> threw an iterator in there, but had to restart tserver to get the new
>>> iterator picked up. Was that an intentional change?
>>>
>>>
Re: VFS class reloading?
Posted by Billie Rinaldi <bi...@gmail.com>.
On Tue, Apr 16, 2013 at 5:39 PM, <dl...@comcast.net> wrote:
>
> Updated my local 1.5 branch and tried to build with "mvn clean package -P
> assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3 locally,
> so that should work. A bunch of tests failed in core with:
>
> Caused by: java.lang.ClassNotFoundException:
> org.codehaus.jackson.map.JsonMappingException
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>
>
> Has anyone else seen this?
>
Yep, I broke that in ACCUMULO-730. See the first comment where I ask if
anyone still needs 0.20.205.0 and what we should do to fix it if they do.
It's not too late to weigh in.
Billie
>
> -- Dave
>
> ----- Original Message -----
> From: "Eric Newton" <er...@gmail.com>
> To: dev@accumulo.apache.org
> Sent: Tuesday, April 16, 2013 7:52:09 PM
> Subject: Re: VFS class reloading?
>
> We have tests for dynamic loading of classes so I'm pretty sure it works.
>
> John, can you repeat the failure?
>
> -Eric
>
>
>
> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
>
> > Looking at the code, it should work. Keith and I had several
> conversations
> > about what the new classloader should do. I believe that he wanted it to
> > behave like the old one and what I see in the code supports that. If it
> is
> > not working, then I would say create a ticket for it for now. I'll try to
> > replicate it tonight if I have time.
> >
> > -----Original Message-----
> > From: Dave Marion [mailto:dlmarion@comcast.net]
> > Sent: Tuesday, April 16, 2013 6:41 PM
> > To: dev@accumulo.apache.org
> > Subject: RE: VFS class reloading?
> >
> > The implementation changed several times, so the pre-1.5 layout may not
> > work. In 1.5, using the bootstrap script, it should put the accumulo jars
> > into HDFS and dynamic loading from there should occur. I'll try and test
> > tonight if I have time.
> >
> > -----Original Message-----
> > From: John Vines [mailto:vines@apache.org]
> > Sent: Tuesday, April 16, 2013 6:30 PM
> > To: Accumulo Dev List
> > Subject: VFS class reloading?
> >
> > Maybe I missed something with the switch to the VFS classloader, but does
> > dynamic loading out of lib/ext no longer work? I had accumulo 1.5
> running,
> > threw an iterator in there, but had to restart tserver to get the new
> > iterator picked up. Was that an intentional change?
> >
> >
>
Re: VFS class reloading?
Posted by dl...@comcast.net.
I was able to confirm that 'accumulo classpath' picked up jars in lib/ext. So it's configured to know about that location.
----- Original Message -----
From: "Eric Newton" <er...@gmail.com>
To: dev@accumulo.apache.org
Sent: Tuesday, April 16, 2013 7:52:09 PM
Subject: Re: VFS class reloading?
We have tests for dynamic loading of classes so I'm pretty sure it works.
John, can you repeat the failure?
-Eric
On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
> Looking at the code, it should work. Keith and I had several conversations
> about what the new classloader should do. I believe that he wanted it to
> behave like the old one and what I see in the code supports that. If it is
> not working, then I would say create a ticket for it for now. I'll try to
> replicate it tonight if I have time.
>
> -----Original Message-----
> From: Dave Marion [mailto:dlmarion@comcast.net]
> Sent: Tuesday, April 16, 2013 6:41 PM
> To: dev@accumulo.apache.org
> Subject: RE: VFS class reloading?
>
> The implementation changed several times, so the pre-1.5 layout may not
> work. In 1.5, using the bootstrap script, it should put the accumulo jars
> into HDFS and dynamic loading from there should occur. I'll try and test
> tonight if I have time.
>
> -----Original Message-----
> From: John Vines [mailto:vines@apache.org]
> Sent: Tuesday, April 16, 2013 6:30 PM
> To: Accumulo Dev List
> Subject: VFS class reloading?
>
> Maybe I missed something with the switch to the VFS classloader, but does
> dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
> threw an iterator in there, but had to restart tserver to get the new
> iterator picked up. Was that an intentional change?
>
>
Re: VFS class reloading?
Posted by Josh Elser <jo...@gmail.com>.
Possibly. Being rather explicit about what we support is definitely
good; finding out when we accidentally break something we're supposed to
support... also a good idea. :D
I'm almost of the mindset to not really encourage people to use 0.20.205
hadoop things anymore, maybe? I have no idea what 1.0 and 1.1 (even 0.23
or 2.0) adoption of Hadoop in the community looks like these days.
On 04/16/2013 08:54 PM, dlmarion@comcast.net wrote:
> Likely. I just followed the directions in the README as I have not kept up with all of the changes in 1.5. It seems that maybe we should have Jenkins build with all of the different profile variations, or at least the ones that we use as examples in the README.
>
> ----- Original Message -----
> From: "Josh Elser" <jo...@gmail.com>
> To: dev@accumulo.apache.org
> Sent: Tuesday, April 16, 2013 8:49:40 PM
> Subject: Re: VFS class reloading?
>
> I wish I could tell you that it worked on my machine, but alas the
> command below did fail on a bunch of core tests via
> Accumulo*FormatTest$MRTester.
>
> Looking into it currently. Maybe someone accidentally broke
> compatibility with the old Hadoop stuff and we need to add a new
> dependency with 0.20.205.0?
>
> On 04/16/2013 08:39 PM, dlmarion@comcast.net wrote:
>> Updated my local 1.5 branch and tried to build with "mvn clean package -P assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3 locally, so that should work. A bunch of tests failed in core with:
>>
>> Caused by: java.lang.ClassNotFoundException: org.codehaus.jackson.map.JsonMappingException
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>>
>>
>> Has anyone else seen this?
>>
>> -- Dave
>>
>> ----- Original Message -----
>> From: "Eric Newton" <er...@gmail.com>
>> To: dev@accumulo.apache.org
>> Sent: Tuesday, April 16, 2013 7:52:09 PM
>> Subject: Re: VFS class reloading?
>>
>> We have tests for dynamic loading of classes so I'm pretty sure it works.
>>
>> John, can you repeat the failure?
>>
>> -Eric
>>
>>
>>
>> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
>>
>>> Looking at the code, it should work. Keith and I had several conversations
>>> about what the new classloader should do. I believe that he wanted it to
>>> behave like the old one and what I see in the code supports that. If it is
>>> not working, then I would say create a ticket for it for now. I'll try to
>>> replicate it tonight if I have time.
>>>
>>> -----Original Message-----
>>> From: Dave Marion [mailto:dlmarion@comcast.net]
>>> Sent: Tuesday, April 16, 2013 6:41 PM
>>> To: dev@accumulo.apache.org
>>> Subject: RE: VFS class reloading?
>>>
>>> The implementation changed several times, so the pre-1.5 layout may not
>>> work. In 1.5, using the bootstrap script, it should put the accumulo jars
>>> into HDFS and dynamic loading from there should occur. I'll try and test
>>> tonight if I have time.
>>>
>>> -----Original Message-----
>>> From: John Vines [mailto:vines@apache.org]
>>> Sent: Tuesday, April 16, 2013 6:30 PM
>>> To: Accumulo Dev List
>>> Subject: VFS class reloading?
>>>
>>> Maybe I missed something with the switch to the VFS classloader, but does
>>> dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
>>> threw an iterator in there, but had to restart tserver to get the new
>>> iterator picked up. Was that an intentional change?
>>>
>>>
>
Re: VFS class reloading?
Posted by dl...@comcast.net.
Likely. I just followed the directions in the README as I have not kept up with all of the changes in 1.5. It seems that maybe we should have Jenkins build with all of the different profile variations, or at least the ones that we use as examples in the README.
----- Original Message -----
From: "Josh Elser" <jo...@gmail.com>
To: dev@accumulo.apache.org
Sent: Tuesday, April 16, 2013 8:49:40 PM
Subject: Re: VFS class reloading?
I wish I could tell you that it worked on my machine, but alas the
command below did fail on a bunch of core tests via
Accumulo*FormatTest$MRTester.
Looking into it currently. Maybe someone accidentally broke
compatibility with the old Hadoop stuff and we need to add a new
dependency with 0.20.205.0?
On 04/16/2013 08:39 PM, dlmarion@comcast.net wrote:
> Updated my local 1.5 branch and tried to build with "mvn clean package -P assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3 locally, so that should work. A bunch of tests failed in core with:
>
> Caused by: java.lang.ClassNotFoundException: org.codehaus.jackson.map.JsonMappingException
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>
>
> Has anyone else seen this?
>
> -- Dave
>
> ----- Original Message -----
> From: "Eric Newton" <er...@gmail.com>
> To: dev@accumulo.apache.org
> Sent: Tuesday, April 16, 2013 7:52:09 PM
> Subject: Re: VFS class reloading?
>
> We have tests for dynamic loading of classes so I'm pretty sure it works.
>
> John, can you repeat the failure?
>
> -Eric
>
>
>
> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
>
>> Looking at the code, it should work. Keith and I had several conversations
>> about what the new classloader should do. I believe that he wanted it to
>> behave like the old one and what I see in the code supports that. If it is
>> not working, then I would say create a ticket for it for now. I'll try to
>> replicate it tonight if I have time.
>>
>> -----Original Message-----
>> From: Dave Marion [mailto:dlmarion@comcast.net]
>> Sent: Tuesday, April 16, 2013 6:41 PM
>> To: dev@accumulo.apache.org
>> Subject: RE: VFS class reloading?
>>
>> The implementation changed several times, so the pre-1.5 layout may not
>> work. In 1.5, using the bootstrap script, it should put the accumulo jars
>> into HDFS and dynamic loading from there should occur. I'll try and test
>> tonight if I have time.
>>
>> -----Original Message-----
>> From: John Vines [mailto:vines@apache.org]
>> Sent: Tuesday, April 16, 2013 6:30 PM
>> To: Accumulo Dev List
>> Subject: VFS class reloading?
>>
>> Maybe I missed something with the switch to the VFS classloader, but does
>> dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
>> threw an iterator in there, but had to restart tserver to get the new
>> iterator picked up. Was that an intentional change?
>>
>>
Re: VFS class reloading?
Posted by Josh Elser <jo...@gmail.com>.
I wish I could tell you that it worked on my machine, but alas the
command below did fail on a bunch of core tests via
Accumulo*FormatTest$MRTester.
Looking into it currently. Maybe someone accidentally broke
compatibility with the old Hadoop stuff and we need to add a new
dependency with 0.20.205.0?
On 04/16/2013 08:39 PM, dlmarion@comcast.net wrote:
> Updated my local 1.5 branch and tried to build with "mvn clean package -P assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3 locally, so that should work. A bunch of tests failed in core with:
>
> Caused by: java.lang.ClassNotFoundException: org.codehaus.jackson.map.JsonMappingException
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>
>
> Has anyone else seen this?
>
> -- Dave
>
> ----- Original Message -----
> From: "Eric Newton" <er...@gmail.com>
> To: dev@accumulo.apache.org
> Sent: Tuesday, April 16, 2013 7:52:09 PM
> Subject: Re: VFS class reloading?
>
> We have tests for dynamic loading of classes so I'm pretty sure it works.
>
> John, can you repeat the failure?
>
> -Eric
>
>
>
> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
>
>> Looking at the code, it should work. Keith and I had several conversations
>> about what the new classloader should do. I believe that he wanted it to
>> behave like the old one and what I see in the code supports that. If it is
>> not working, then I would say create a ticket for it for now. I'll try to
>> replicate it tonight if I have time.
>>
>> -----Original Message-----
>> From: Dave Marion [mailto:dlmarion@comcast.net]
>> Sent: Tuesday, April 16, 2013 6:41 PM
>> To: dev@accumulo.apache.org
>> Subject: RE: VFS class reloading?
>>
>> The implementation changed several times, so the pre-1.5 layout may not
>> work. In 1.5, using the bootstrap script, it should put the accumulo jars
>> into HDFS and dynamic loading from there should occur. I'll try and test
>> tonight if I have time.
>>
>> -----Original Message-----
>> From: John Vines [mailto:vines@apache.org]
>> Sent: Tuesday, April 16, 2013 6:30 PM
>> To: Accumulo Dev List
>> Subject: VFS class reloading?
>>
>> Maybe I missed something with the switch to the VFS classloader, but does
>> dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
>> threw an iterator in there, but had to restart tserver to get the new
>> iterator picked up. Was that an intentional change?
>>
>>
Re: VFS class reloading?
Posted by dl...@comcast.net.
I would believe that at runtime, but during the build?
----- Original Message -----
From: "Corey Nolet" <cn...@texeltek.com>
To: dev@accumulo.apache.org
Sent: Tuesday, April 16, 2013 8:47:13 PM
Subject: Re: VFS class reloading?
I've run into version conflicts with Hadoop 0.20.2 CDH3 series and jackson versions < 1.9 in the past.
On Apr 16, 2013, at 8:39 PM, dlmarion@comcast.net wrote:
>
> Updated my local 1.5 branch and tried to build with "mvn clean package -P assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3 locally, so that should work. A bunch of tests failed in core with:
>
> Caused by: java.lang.ClassNotFoundException: org.codehaus.jackson.map.JsonMappingException
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>
>
> Has anyone else seen this?
>
> -- Dave
>
> ----- Original Message -----
> From: "Eric Newton" <er...@gmail.com>
> To: dev@accumulo.apache.org
> Sent: Tuesday, April 16, 2013 7:52:09 PM
> Subject: Re: VFS class reloading?
>
> We have tests for dynamic loading of classes so I'm pretty sure it works.
>
> John, can you repeat the failure?
>
> -Eric
>
>
>
> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
>
>> Looking at the code, it should work. Keith and I had several conversations
>> about what the new classloader should do. I believe that he wanted it to
>> behave like the old one and what I see in the code supports that. If it is
>> not working, then I would say create a ticket for it for now. I'll try to
>> replicate it tonight if I have time.
>>
>> -----Original Message-----
>> From: Dave Marion [mailto:dlmarion@comcast.net]
>> Sent: Tuesday, April 16, 2013 6:41 PM
>> To: dev@accumulo.apache.org
>> Subject: RE: VFS class reloading?
>>
>> The implementation changed several times, so the pre-1.5 layout may not
>> work. In 1.5, using the bootstrap script, it should put the accumulo jars
>> into HDFS and dynamic loading from there should occur. I'll try and test
>> tonight if I have time.
>>
>> -----Original Message-----
>> From: John Vines [mailto:vines@apache.org]
>> Sent: Tuesday, April 16, 2013 6:30 PM
>> To: Accumulo Dev List
>> Subject: VFS class reloading?
>>
>> Maybe I missed something with the switch to the VFS classloader, but does
>> dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
>> threw an iterator in there, but had to restart tserver to get the new
>> iterator picked up. Was that an intentional change?
>>
>>
Re: VFS class reloading?
Posted by Corey Nolet <cn...@texeltek.com>.
I've run into version conflicts with Hadoop 0.20.2 CDH3 series and jackson versions < 1.9 in the past.
On Apr 16, 2013, at 8:39 PM, dlmarion@comcast.net wrote:
>
> Updated my local 1.5 branch and tried to build with "mvn clean package -P assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3 locally, so that should work. A bunch of tests failed in core with:
>
> Caused by: java.lang.ClassNotFoundException: org.codehaus.jackson.map.JsonMappingException
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>
>
> Has anyone else seen this?
>
> -- Dave
>
> ----- Original Message -----
> From: "Eric Newton" <er...@gmail.com>
> To: dev@accumulo.apache.org
> Sent: Tuesday, April 16, 2013 7:52:09 PM
> Subject: Re: VFS class reloading?
>
> We have tests for dynamic loading of classes so I'm pretty sure it works.
>
> John, can you repeat the failure?
>
> -Eric
>
>
>
> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
>
>> Looking at the code, it should work. Keith and I had several conversations
>> about what the new classloader should do. I believe that he wanted it to
>> behave like the old one and what I see in the code supports that. If it is
>> not working, then I would say create a ticket for it for now. I'll try to
>> replicate it tonight if I have time.
>>
>> -----Original Message-----
>> From: Dave Marion [mailto:dlmarion@comcast.net]
>> Sent: Tuesday, April 16, 2013 6:41 PM
>> To: dev@accumulo.apache.org
>> Subject: RE: VFS class reloading?
>>
>> The implementation changed several times, so the pre-1.5 layout may not
>> work. In 1.5, using the bootstrap script, it should put the accumulo jars
>> into HDFS and dynamic loading from there should occur. I'll try and test
>> tonight if I have time.
>>
>> -----Original Message-----
>> From: John Vines [mailto:vines@apache.org]
>> Sent: Tuesday, April 16, 2013 6:30 PM
>> To: Accumulo Dev List
>> Subject: VFS class reloading?
>>
>> Maybe I missed something with the switch to the VFS classloader, but does
>> dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
>> threw an iterator in there, but had to restart tserver to get the new
>> iterator picked up. Was that an intentional change?
>>
>>
Re: VFS class reloading?
Posted by Josh Elser <jo...@gmail.com>.
Dave,
Patch attached which let me build against 0.20.205.0
Run: mvn package -Dhadoop.profile=0.20 -Passemble
I took the extra second to follow the same convention we have for Hadoop
1 and 2. I completely guessed on the version of jackson-mapper-asl we
should use, so that's why I didn't commit this directly. I think I also
want to mark the jackson-mapper-asl deps as provided? I dunno; it's odd
because the 0.20.205.0 pom didn't directly depend on j-m-a and it's been
far too long a week already to dig further atm ;)
Hope that helps.
On 04/16/2013 08:39 PM, dlmarion@comcast.net wrote:
> Updated my local 1.5 branch and tried to build with "mvn clean package -P assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3 locally, so that should work. A bunch of tests failed in core with:
>
> Caused by: java.lang.ClassNotFoundException: org.codehaus.jackson.map.JsonMappingException
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>
>
> Has anyone else seen this?
>
> -- Dave
>
> ----- Original Message -----
> From: "Eric Newton" <er...@gmail.com>
> To: dev@accumulo.apache.org
> Sent: Tuesday, April 16, 2013 7:52:09 PM
> Subject: Re: VFS class reloading?
>
> We have tests for dynamic loading of classes so I'm pretty sure it works.
>
> John, can you repeat the failure?
>
> -Eric
>
>
>
> On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
>
>> Looking at the code, it should work. Keith and I had several conversations
>> about what the new classloader should do. I believe that he wanted it to
>> behave like the old one and what I see in the code supports that. If it is
>> not working, then I would say create a ticket for it for now. I'll try to
>> replicate it tonight if I have time.
>>
>> -----Original Message-----
>> From: Dave Marion [mailto:dlmarion@comcast.net]
>> Sent: Tuesday, April 16, 2013 6:41 PM
>> To: dev@accumulo.apache.org
>> Subject: RE: VFS class reloading?
>>
>> The implementation changed several times, so the pre-1.5 layout may not
>> work. In 1.5, using the bootstrap script, it should put the accumulo jars
>> into HDFS and dynamic loading from there should occur. I'll try and test
>> tonight if I have time.
>>
>> -----Original Message-----
>> From: John Vines [mailto:vines@apache.org]
>> Sent: Tuesday, April 16, 2013 6:30 PM
>> To: Accumulo Dev List
>> Subject: VFS class reloading?
>>
>> Maybe I missed something with the switch to the VFS classloader, but does
>> dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
>> threw an iterator in there, but had to restart tserver to get the new
>> iterator picked up. Was that an intentional change?
>>
>>
Re: VFS class reloading?
Posted by dl...@comcast.net.
Updated my local 1.5 branch and tried to build with "mvn clean package -P assemble -Dhadoop.version=0.20.205.0". I'm running CDH3 Update 3 locally, so that should work. A bunch of tests failed in core with:
Caused by: java.lang.ClassNotFoundException: org.codehaus.jackson.map.JsonMappingException
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Has anyone else seen this?
-- Dave
----- Original Message -----
From: "Eric Newton" <er...@gmail.com>
To: dev@accumulo.apache.org
Sent: Tuesday, April 16, 2013 7:52:09 PM
Subject: Re: VFS class reloading?
We have tests for dynamic loading of classes so I'm pretty sure it works.
John, can you repeat the failure?
-Eric
On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
> Looking at the code, it should work. Keith and I had several conversations
> about what the new classloader should do. I believe that he wanted it to
> behave like the old one and what I see in the code supports that. If it is
> not working, then I would say create a ticket for it for now. I'll try to
> replicate it tonight if I have time.
>
> -----Original Message-----
> From: Dave Marion [mailto:dlmarion@comcast.net]
> Sent: Tuesday, April 16, 2013 6:41 PM
> To: dev@accumulo.apache.org
> Subject: RE: VFS class reloading?
>
> The implementation changed several times, so the pre-1.5 layout may not
> work. In 1.5, using the bootstrap script, it should put the accumulo jars
> into HDFS and dynamic loading from there should occur. I'll try and test
> tonight if I have time.
>
> -----Original Message-----
> From: John Vines [mailto:vines@apache.org]
> Sent: Tuesday, April 16, 2013 6:30 PM
> To: Accumulo Dev List
> Subject: VFS class reloading?
>
> Maybe I missed something with the switch to the VFS classloader, but does
> dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
> threw an iterator in there, but had to restart tserver to get the new
> iterator picked up. Was that an intentional change?
>
>
Re: VFS class reloading?
Posted by Eric Newton <er...@gmail.com>.
We have tests for dynamic loading of classes so I'm pretty sure it works.
John, can you repeat the failure?
-Eric
On Tue, Apr 16, 2013 at 6:50 PM, Dave Marion <dl...@comcast.net> wrote:
> Looking at the code, it should work. Keith and I had several conversations
> about what the new classloader should do. I believe that he wanted it to
> behave like the old one and what I see in the code supports that. If it is
> not working, then I would say create a ticket for it for now. I'll try to
> replicate it tonight if I have time.
>
> -----Original Message-----
> From: Dave Marion [mailto:dlmarion@comcast.net]
> Sent: Tuesday, April 16, 2013 6:41 PM
> To: dev@accumulo.apache.org
> Subject: RE: VFS class reloading?
>
> The implementation changed several times, so the pre-1.5 layout may not
> work. In 1.5, using the bootstrap script, it should put the accumulo jars
> into HDFS and dynamic loading from there should occur. I'll try and test
> tonight if I have time.
>
> -----Original Message-----
> From: John Vines [mailto:vines@apache.org]
> Sent: Tuesday, April 16, 2013 6:30 PM
> To: Accumulo Dev List
> Subject: VFS class reloading?
>
> Maybe I missed something with the switch to the VFS classloader, but does
> dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
> threw an iterator in there, but had to restart tserver to get the new
> iterator picked up. Was that an intentional change?
>
>
RE: VFS class reloading?
Posted by Dave Marion <dl...@comcast.net>.
Looking at the code, it should work. Keith and I had several conversations
about what the new classloader should do. I believe that he wanted it to
behave like the old one and what I see in the code supports that. If it is
not working, then I would say create a ticket for it for now. I'll try to
replicate it tonight if I have time.
-----Original Message-----
From: Dave Marion [mailto:dlmarion@comcast.net]
Sent: Tuesday, April 16, 2013 6:41 PM
To: dev@accumulo.apache.org
Subject: RE: VFS class reloading?
The implementation changed several times, so the pre-1.5 layout may not
work. In 1.5, using the bootstrap script, it should put the accumulo jars
into HDFS and dynamic loading from there should occur. I'll try and test
tonight if I have time.
-----Original Message-----
From: John Vines [mailto:vines@apache.org]
Sent: Tuesday, April 16, 2013 6:30 PM
To: Accumulo Dev List
Subject: VFS class reloading?
Maybe I missed something with the switch to the VFS classloader, but does
dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
threw an iterator in there, but had to restart tserver to get the new
iterator picked up. Was that an intentional change?
RE: VFS class reloading?
Posted by Dave Marion <dl...@comcast.net>.
The implementation changed several times, so the pre-1.5 layout may not
work. In 1.5, using the bootstrap script, it should put the accumulo jars
into HDFS and dynamic loading from there should occur. I'll try and test
tonight if I have time.
-----Original Message-----
From: John Vines [mailto:vines@apache.org]
Sent: Tuesday, April 16, 2013 6:30 PM
To: Accumulo Dev List
Subject: VFS class reloading?
Maybe I missed something with the switch to the VFS classloader, but does
dynamic loading out of lib/ext no longer work? I had accumulo 1.5 running,
threw an iterator in there, but had to restart tserver to get the new
iterator picked up. Was that an intentional change?