You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Felipe Gutierrez <fe...@gmail.com> on 2020/06/15 10:30:58 UTC
Have already anyone tried to monitor Flink applications using VisualVM?
Hi,
I want to run a flink job with the JVM parameters
"-Dcom.sun.management.jmxremote.port=3333
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.authenticate=false" in order to monitor
this job with VisualVM. So I am doing like this:
./bin/flink run ../TaxiRideCount.jar -yD
env.java.opts="-Dcom.sun.management.jmxremote.port=3333
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.authenticate=false" -input
/home/flink/nycTaxiRides.gz -output mqtt -sinkHost 127.0.0.1
The problem is that when I try to add a JMX connection from VisualVM
the connection seems to not capture anything.
I ensure that VisualVM is able to listen the java process in my
machine since I can see the TaskManagerRunner and the
StandaloneSessionClusterEntrypoint. However, VisualVM is not able to
show the thread tab for those processes as well. This is why I am
trying to add the JVM parameters when submitting the link job [1]. A
common issue is also when the VisualVM and the java processes are not
using the same JDK. However, this is also not my case. All
applications are using OpenJDK 64-Bit Server VM version 1.8.0_252.
Have already anyone tried to monitor Flink applications using VisualVM?
Thanks, Felipe
[1] https://stackoverflow.com/questions/16023507/why-isnt-visualvm-showing-all-the-normal-tabs
--
-- Felipe Gutierrez
-- skype: felipe.o.gutierrez
-- https://felipeogutierrez.blogspot.com
Re: Have already anyone tried to monitor Flink applications using VisualVM?
Posted by Robert Metzger <rm...@apache.org>.
Thanks a lot for posting the solution!
It might be helpful for other users.
On Mon, Jun 15, 2020 at 2:36 PM Felipe Gutierrez <
felipe.o.gutierrez@gmail.com> wrote:
> Hi, I managed to find the solution. Just for the record I am gonna post
> here:
>
> I added the JMX parameters on the file bin/flink to submit the FLink
> job using these parameters.
>
> log_setting=(-Dcom.sun.management.jmxremote
> -Dcom.sun.management.jmxremote.port="9010"
> -Dcom.sun.management.jmxremote.local.only="false"
> -Dcom.sun.management.jmxremote.authenticate="false"
> -Dcom.sun.management.jmxremote.ssl="false" -Dlog.file="$log"
> -Dlog4j.configuration=file:"$FLINK_CONF_DIR"/log4j-cli.properties
> -Dlog4j.configurationFile=file:"$FLINK_CONF_DIR"/log4j-cli.properties
> -Dlogback.configurationFile=file:"$FLINK_CONF_DIR"/logback.xml)
>
> After this I am able to monitor the threads of my application and
> collect samples of CPU and memory using VisualVM. Although I am
> getting some other errors which I think it are related to other
> configurations.
>
> "main" #1 prio=5 os_prio=0 tid=0x00007f876000c800 nid=0x4bfa waiting
> on condition [0x00007f8768a32000]
> java.lang.Thread.State: WAITING (parking)
> at sun.misc.Unsafe.park(Native Method)
> - parking to wait for <0x000000076f04ea00> (a
> java.util.concurrent.CompletableFuture$Signaller)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> at
> java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
> at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
> at
> java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
> at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
> at
> org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:93)
> at
> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1643)
> at
> org.apache.flink.streaming.examples.aggregate.TaxiRideCountPreAggregate.main(TaxiRideCountPreAggregate.java:119)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:321)
> at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:205)
> at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:148)
> at
> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:662)
> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:210)
> at
> org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:893)
> at
> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:966)
> at
> org.apache.flink.client.cli.CliFrontend$$Lambda$38/510464020.call(Unknown
> Source)
> at
> org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:966)
>
> --
> -- Felipe Gutierrez
> -- skype: felipe.o.gutierrez
> -- https://felipeogutierrez.blogspot.com
>
> On Mon, Jun 15, 2020 at 12:30 PM Felipe Gutierrez
> <fe...@gmail.com> wrote:
> >
> > Hi,
> >
> > I want to run a flink job with the JVM parameters
> > "-Dcom.sun.management.jmxremote.port=3333
> > -Dcom.sun.management.jmxremote.ssl=false
> > -Dcom.sun.management.jmxremote.authenticate=false" in order to monitor
> > this job with VisualVM. So I am doing like this:
> >
> > ./bin/flink run ../TaxiRideCount.jar -yD
> > env.java.opts="-Dcom.sun.management.jmxremote.port=3333
> > -Dcom.sun.management.jmxremote.ssl=false
> > -Dcom.sun.management.jmxremote.authenticate=false" -input
> > /home/flink/nycTaxiRides.gz -output mqtt -sinkHost 127.0.0.1
> >
> > The problem is that when I try to add a JMX connection from VisualVM
> > the connection seems to not capture anything.
> >
> > I ensure that VisualVM is able to listen the java process in my
> > machine since I can see the TaskManagerRunner and the
> > StandaloneSessionClusterEntrypoint. However, VisualVM is not able to
> > show the thread tab for those processes as well. This is why I am
> > trying to add the JVM parameters when submitting the link job [1]. A
> > common issue is also when the VisualVM and the java processes are not
> > using the same JDK. However, this is also not my case. All
> > applications are using OpenJDK 64-Bit Server VM version 1.8.0_252.
> >
> > Have already anyone tried to monitor Flink applications using VisualVM?
> >
> > Thanks, Felipe
> > [1]
> https://stackoverflow.com/questions/16023507/why-isnt-visualvm-showing-all-the-normal-tabs
> > --
> > -- Felipe Gutierrez
> > -- skype: felipe.o.gutierrez
> > -- https://felipeogutierrez.blogspot.com
>
Re: Have already anyone tried to monitor Flink applications using VisualVM?
Posted by Felipe Gutierrez <fe...@gmail.com>.
Hi, I managed to find the solution. Just for the record I am gonna post here:
I added the JMX parameters on the file bin/flink to submit the FLink
job using these parameters.
log_setting=(-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.port="9010"
-Dcom.sun.management.jmxremote.local.only="false"
-Dcom.sun.management.jmxremote.authenticate="false"
-Dcom.sun.management.jmxremote.ssl="false" -Dlog.file="$log"
-Dlog4j.configuration=file:"$FLINK_CONF_DIR"/log4j-cli.properties
-Dlog4j.configurationFile=file:"$FLINK_CONF_DIR"/log4j-cli.properties
-Dlogback.configurationFile=file:"$FLINK_CONF_DIR"/logback.xml)
After this I am able to monitor the threads of my application and
collect samples of CPU and memory using VisualVM. Although I am
getting some other errors which I think it are related to other
configurations.
"main" #1 prio=5 os_prio=0 tid=0x00007f876000c800 nid=0x4bfa waiting
on condition [0x00007f8768a32000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000076f04ea00> (a
java.util.concurrent.CompletableFuture$Signaller)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
at java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
at java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
at org.apache.flink.client.program.StreamContextEnvironment.execute(StreamContextEnvironment.java:93)
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1643)
at org.apache.flink.streaming.examples.aggregate.TaxiRideCountPreAggregate.main(TaxiRideCountPreAggregate.java:119)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:321)
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:205)
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:148)
at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:662)
at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:210)
at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:893)
at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:966)
at org.apache.flink.client.cli.CliFrontend$$Lambda$38/510464020.call(Unknown
Source)
at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:966)
--
-- Felipe Gutierrez
-- skype: felipe.o.gutierrez
-- https://felipeogutierrez.blogspot.com
On Mon, Jun 15, 2020 at 12:30 PM Felipe Gutierrez
<fe...@gmail.com> wrote:
>
> Hi,
>
> I want to run a flink job with the JVM parameters
> "-Dcom.sun.management.jmxremote.port=3333
> -Dcom.sun.management.jmxremote.ssl=false
> -Dcom.sun.management.jmxremote.authenticate=false" in order to monitor
> this job with VisualVM. So I am doing like this:
>
> ./bin/flink run ../TaxiRideCount.jar -yD
> env.java.opts="-Dcom.sun.management.jmxremote.port=3333
> -Dcom.sun.management.jmxremote.ssl=false
> -Dcom.sun.management.jmxremote.authenticate=false" -input
> /home/flink/nycTaxiRides.gz -output mqtt -sinkHost 127.0.0.1
>
> The problem is that when I try to add a JMX connection from VisualVM
> the connection seems to not capture anything.
>
> I ensure that VisualVM is able to listen the java process in my
> machine since I can see the TaskManagerRunner and the
> StandaloneSessionClusterEntrypoint. However, VisualVM is not able to
> show the thread tab for those processes as well. This is why I am
> trying to add the JVM parameters when submitting the link job [1]. A
> common issue is also when the VisualVM and the java processes are not
> using the same JDK. However, this is also not my case. All
> applications are using OpenJDK 64-Bit Server VM version 1.8.0_252.
>
> Have already anyone tried to monitor Flink applications using VisualVM?
>
> Thanks, Felipe
> [1] https://stackoverflow.com/questions/16023507/why-isnt-visualvm-showing-all-the-normal-tabs
> --
> -- Felipe Gutierrez
> -- skype: felipe.o.gutierrez
> -- https://felipeogutierrez.blogspot.com