You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@netbeans.apache.org by Michael Bien <mb...@gmail.com> on 2020/09/26 14:19:31 UTC
NB + DynAppCDS
Hello,
did anyone try to get CDS working with NetBeans before?
I just ran a little experiment and tried to start NB 12.1 with dynamic
class data archives[1][2].
(dynamic CDS (java 13+) is basically a fancy word for a second
application specific archive, layered on top of the JDK specific class
data archive, which is mapped into shared memory on jvm startup for
various reasons. (faster startup, potential of saving mem by sharing it
between mult. JVMs etc))
unfortunately i couldn't get it to work at first because NB thought the
JDK disappeared as soon the JVM was started with the archive :)
what i did (JDK 15, NB 12.1 on linux, started with "sh bin/netbeans" to
see startup errors right away + to be able to use relative filename paths):
0) remove the evil -J-XX:+IgnoreUnrecognizedVMOptions from
netbeans.conf->netbeans_default_options before starting any experiment
1) first I verified that the JDK base CDS file exists and is working by
adding -J-Xshare:on and checked if it still starts - worked fine. (if
this doesn't work, you can regenerate the JDK CDS with "sudo
[JDK]/bin/java -Xshare:dump")
2) start with -J-Xshare:on -J-XX:ArchiveClassesAtExit=nb.jsa
Opened a pom, edited a java file and built a maven project. Closed IDE.
(the JVM will keep going for a few moments until the archiving is finished)
a file called nb.jsa should be now in the netbeans folder. 154 MB large
in my case.
3) start with -J-Xshare:on -J-XX:SharedArchiveFile=nb.jsa
and i got this exception:
[mbien@longbow netbeans_12.1]$ sh bin/netbeans
java.lang.IllegalStateException: Were trying to install a module that
had never been checked: StandardModule:org.netbeans.api.debugger.jpda
jarFile:
/home/mbien/dev/netbeans_12.1/java/modules/org-netbeans-api-debugger-jpda.jar
at org.netbeans.ModuleManager.enable(ModuleManager.java:1363)
at org.netbeans.ModuleManager.enable(ModuleManager.java:1254)
at org.netbeans.core.startup.ModuleList.installNew(ModuleList.java:315)
at org.netbeans.core.startup.ModuleList.trigger(ModuleList.java:251)
at
org.netbeans.core.startup.ModuleSystem.restore(ModuleSystem.java:298)
at org.netbeans.core.startup.Main.getModuleSystem(Main.java:156)
at org.netbeans.core.startup.Main.getModuleSystem(Main.java:125)
at org.netbeans.core.startup.Main.start(Main.java:282)
at org.netbeans.core.startup.TopThreadGroup.run(TopThreadGroup.java:98)
at java.base/java.lang.Thread.run(Thread.java:832)
Caused by: org.netbeans.InvalidException: <b>The JDK is missing and is
required to run some NetBeans modules</b><br> Please use the --jdkhome
command line option to specify a JDK<br>installation or see <a
href="http://wiki.netbeans.org/FaqRunningOnJre">http://wiki.netbeans.org/FaqRunningOnJre</a>
for<br> more information.
at org.netbeans.ModuleManager.enable(ModuleManager.java:1345)
... 9 more
@
https://github.com/apache/netbeans/blob/12.1/platform/o.n.bootstrap/src/org/netbeans/ModuleManager.java#L1345
after staring at the code for a bit i decided to remove the check [3]
and test again... and it worked. (Btw i don't think the exception msg
text is correct, maybe the check used to do something else once?)
thats when i ran out of time so i thought i write it down and send it to
the list.
note1: older JDKs will require slightly different JVM flags e.g
additional -XX:+UseAppCDS + the enable experimental options flag, so i
recommend to use the latest JDK for now to keep it simple
note2: i did also try the old approach which would work on JDK 11 (JEP
310, java 10+):
1) -J-Xshare:off -J-XX:DumpLoadedClassList=nbclasses.list
2) -J-Xshare:dump -J-XX:SharedClassListFile=nbclasses.list
-J-XX:SharedArchiveFile=app.jsa
3) -J-Xshare:on -J-XX:SharedArchiveFile=app.jsa
smaller file but same result
best regards,
michael
[1] https://openjdk.java.net/jeps/350
[2] https://mbien.dev/blog/entry/dynamic-application-class-data-sharing
(old blog entry)
[3]
https://github.com/apache/netbeans/blob/12.1/platform/o.n.bootstrap/src/org/netbeans/ModuleManager.java#L1336-L1350
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@netbeans.apache.org
For additional commands, e-mail: dev-help@netbeans.apache.org
For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists
Re: NB + DynAppCDS
Posted by Michael Bien <mb...@gmail.com>.
I went for another round and this time actually measured startup time
with and without DynAppCDS enabled.
just as sidenote:
testing startup time of anything on linux is a bit difficult since the
kernel will just keep caching the filesystem (if you have enough RAM)
until everything is started out of memory anyway. I am also running
everything on NVME storage, this makes random access already really
fast. However, there is still a reason why CDS has the potential to
speed things up: bytecode verification is basically skipped, it will
just run a few signature checks on the archive - the bytecode was
already verified during archive creation.
To get a realistic test scenario i used my regular IDE with ~15 projects
open. (swapped the boot.jar to make it work)
I stopped the time the moment the editor rendered code. (probably not
the best way of doing this because there are a lot of concurrent tasks
going on during startup, this is certainly not the last)
CDS off, DynAppCDS off: 8.5s
CDS on, DynAppCDS off: 8.1s
CDS on, DynAppCDS on: 7.3s
I ran it 3 times for each setting, individual runs were fairly similar -
took the average.
So it is measurably faster even on NVME with warmed up filesystem cache,
but you probably won't perceive a 1s startup difference on a desktop app
which is taking several seconds to start. You also would have to
regenerate the archive every time a plugin is installed or updated or
you enter classloading hell.
best regards,
michael
On 26.09.20 16:19, Michael Bien wrote:
> Hello,
>
> did anyone try to get CDS working with NetBeans before?
>
> I just ran a little experiment and tried to start NB 12.1 with dynamic
> class data archives[1][2].
>
> (dynamic CDS (java 13+) is basically a fancy word for a second
> application specific archive, layered on top of the JDK specific class
> data archive, which is mapped into shared memory on jvm startup for
> various reasons. (faster startup, potential of saving mem by sharing
> it between mult. JVMs etc))
>
> unfortunately i couldn't get it to work at first because NB thought
> the JDK disappeared as soon the JVM was started with the archive :)
>
>
> what i did (JDK 15, NB 12.1 on linux, started with "sh bin/netbeans"
> to see startup errors right away + to be able to use relative filename
> paths):
>
> 0) remove the evil -J-XX:+IgnoreUnrecognizedVMOptions from
> netbeans.conf->netbeans_default_options before starting any experiment
>
> 1) first I verified that the JDK base CDS file exists and is working
> by adding -J-Xshare:on and checked if it still starts - worked fine.
> (if this doesn't work, you can regenerate the JDK CDS with "sudo
> [JDK]/bin/java -Xshare:dump")
>
> 2) start with -J-Xshare:on -J-XX:ArchiveClassesAtExit=nb.jsa
>
> Opened a pom, edited a java file and built a maven project. Closed
> IDE. (the JVM will keep going for a few moments until the archiving is
> finished)
>
> a file called nb.jsa should be now in the netbeans folder. 154 MB
> large in my case.
>
> 3) start with -J-Xshare:on -J-XX:SharedArchiveFile=nb.jsa
>
> and i got this exception:
>
> [mbien@longbow netbeans_12.1]$ sh bin/netbeans
> java.lang.IllegalStateException: Were trying to install a module that
> had never been checked: StandardModule:org.netbeans.api.debugger.jpda
> jarFile:
> /home/mbien/dev/netbeans_12.1/java/modules/org-netbeans-api-debugger-jpda.jar
> at org.netbeans.ModuleManager.enable(ModuleManager.java:1363)
> at org.netbeans.ModuleManager.enable(ModuleManager.java:1254)
> at
> org.netbeans.core.startup.ModuleList.installNew(ModuleList.java:315)
> at org.netbeans.core.startup.ModuleList.trigger(ModuleList.java:251)
> at
> org.netbeans.core.startup.ModuleSystem.restore(ModuleSystem.java:298)
> at org.netbeans.core.startup.Main.getModuleSystem(Main.java:156)
> at org.netbeans.core.startup.Main.getModuleSystem(Main.java:125)
> at org.netbeans.core.startup.Main.start(Main.java:282)
> at
> org.netbeans.core.startup.TopThreadGroup.run(TopThreadGroup.java:98)
> at java.base/java.lang.Thread.run(Thread.java:832)
> Caused by: org.netbeans.InvalidException: <b>The JDK is missing and is
> required to run some NetBeans modules</b><br> Please use the --jdkhome
> command line option to specify a JDK<br>installation or see <a
> href="http://wiki.netbeans.org/FaqRunningOnJre">http://wiki.netbeans.org/FaqRunningOnJre</a>
> for<br> more information.
> at org.netbeans.ModuleManager.enable(ModuleManager.java:1345)
> ... 9 more
>
> @
> https://github.com/apache/netbeans/blob/12.1/platform/o.n.bootstrap/src/org/netbeans/ModuleManager.java#L1345
>
> after staring at the code for a bit i decided to remove the check [3]
> and test again... and it worked. (Btw i don't think the exception msg
> text is correct, maybe the check used to do something else once?)
>
> thats when i ran out of time so i thought i write it down and send it
> to the list.
>
>
> note1: older JDKs will require slightly different JVM flags e.g
> additional -XX:+UseAppCDS + the enable experimental options flag, so i
> recommend to use the latest JDK for now to keep it simple
>
> note2: i did also try the old approach which would work on JDK 11 (JEP
> 310, java 10+):
>
> 1) -J-Xshare:off -J-XX:DumpLoadedClassList=nbclasses.list
> 2) -J-Xshare:dump -J-XX:SharedClassListFile=nbclasses.list
> -J-XX:SharedArchiveFile=app.jsa
> 3) -J-Xshare:on -J-XX:SharedArchiveFile=app.jsa
>
> smaller file but same result
>
>
> best regards,
>
> michael
>
> [1] https://openjdk.java.net/jeps/350
>
> [2]
> https://mbien.dev/blog/entry/dynamic-application-class-data-sharing
> (old blog entry)
>
> [3]
> https://github.com/apache/netbeans/blob/12.1/platform/o.n.bootstrap/src/org/netbeans/ModuleManager.java#L1336-L1350
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@netbeans.apache.org
For additional commands, e-mail: dev-help@netbeans.apache.org
For further information about the NetBeans mailing lists, visit:
https://cwiki.apache.org/confluence/display/NETBEANS/Mailing+lists