You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by 程龙 <13...@163.com> on 2020/06/22 03:43:11 UTC
flink 通过 --classpath 传入https-xxx.xxx.jar 在1.8上正常运行 在flink1.10 就会报传入的jar包找不到
2020-06-22 10:16:34,379 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from SCHEDULED to DEPLOYING.
2020-06-22 10:16:34,379 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Sink: Unnamed (6/6) (attempt #0) to container_1590655249980_0081_01_000002 @ al-bj-bigdata-inf-research-flink04 (dataPort=34781)
2020-06-22 10:16:34,456 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (5/6) (aca298438b9eb6fcf295cb8af6eebcd8) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,481 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,492 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (1/6) (44ca248aba351026452ba4abdb5f33a6) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,497 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (1/8) (70612735eb755269fe9590e8ab51d3e2) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,512 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (2/8) (baba331cd6bcde1f5a6024eac0b953b4) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,524 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (4/6) (a34992362c2cf3634a29bd5a9c188754) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,531 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (2/6) (7683c15e3ebb3e718c2439c6e32f0d7d) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,564 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (6/6) (6ab1aaa5e1811c79c702197f984e9bb6) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,609 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (1/6) (6245b508b8e0494f06ef71c6ad4954b6) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,616 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (4/8) (2ea049476f0b48fcd85dcd9084091e9f) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,650 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (2/6) (e785e44e4212dcc5279bcde761b28292) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,656 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (5/6) (97a5e72f731d14aa97d93253b71b6aeb) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,662 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (7/8) (59babdbc2d7bea362a2794a966fe59ef) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,664 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (3/6) (aed33b78cc847561908ea43164e0311a) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,669 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (6/8) (fd87d0111b10e9f9027068a72e9ce209) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,726 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,729 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (8/8) (22b73fa7f7435a405e1102a3480c09c1) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:34,760 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (4/6) (4c677579ef44cf394618af38a75497da) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:37,081 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 1 @ 1592792197072 for job 1797e2f64b7b1caeb6356608290263cc.
2020-06-22 10:16:45,065 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (3/6) (d9a9c913dcbf782bd933b0adae157b38) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:45,066 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (5/8) (39dbdd04e2066d1d93be1641c0ab7add) switched from DEPLOYING to RUNNING.
2020-06-22 10:16:48,512 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from RUNNING to FAILED on org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot@25d7d2c5.
java.lang.NoClassDefFoundError: core
看日志是在部分task里面报错
Re:Re:flink 通过 --classpath 传入https-xxx.xxx.jar 在1.8上正常运行 在flink1.10 就会报传入的jar包找不到
Posted by 程龙 <13...@163.com>.
嗯 确认都能访问 使用http的方式
在 2020-06-23 10:04:55，"Weixubin" <18...@163.com> 写道：
>和版本应该没什么关系。如果是多节点部署的情况下，-C 所指定的URL 需要各个节点都能访问得到。 确认下该URL能被所有节点访问到吗
> Best,
> Bin
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>At 2020-06-22 11:43:11, "程龙" <13...@163.com> wrote:
>>2020-06-22 10:16:34,379 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from SCHEDULED to DEPLOYING.
>>2020-06-22 10:16:34,379 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Sink: Unnamed (6/6) (attempt #0) to container_1590655249980_0081_01_000002 @ al-bj-bigdata-inf-research-flink04 (dataPort=34781)
>>2020-06-22 10:16:34,456 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (5/6) (aca298438b9eb6fcf295cb8af6eebcd8) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,481 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,492 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (1/6) (44ca248aba351026452ba4abdb5f33a6) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,497 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (1/8) (70612735eb755269fe9590e8ab51d3e2) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,512 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (2/8) (baba331cd6bcde1f5a6024eac0b953b4) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,524 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (4/6) (a34992362c2cf3634a29bd5a9c188754) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,531 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (2/6) (7683c15e3ebb3e718c2439c6e32f0d7d) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,564 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (6/6) (6ab1aaa5e1811c79c702197f984e9bb6) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,609 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (1/6) (6245b508b8e0494f06ef71c6ad4954b6) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,616 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (4/8) (2ea049476f0b48fcd85dcd9084091e9f) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,650 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (2/6) (e785e44e4212dcc5279bcde761b28292) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,656 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (5/6) (97a5e72f731d14aa97d93253b71b6aeb) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,662 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (7/8) (59babdbc2d7bea362a2794a966fe59ef) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,664 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (3/6) (aed33b78cc847561908ea43164e0311a) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,669 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (6/8) (fd87d0111b10e9f9027068a72e9ce209) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,726 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,729 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (8/8) (22b73fa7f7435a405e1102a3480c09c1) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:34,760 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (4/6) (4c677579ef44cf394618af38a75497da) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:37,081 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 1 @ 1592792197072 for job 1797e2f64b7b1caeb6356608290263cc.
>>2020-06-22 10:16:45,065 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (3/6) (d9a9c913dcbf782bd933b0adae157b38) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:45,066 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (5/8) (39dbdd04e2066d1d93be1641c0ab7add) switched from DEPLOYING to RUNNING.
>>2020-06-22 10:16:48,512 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from RUNNING to FAILED on org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot@25d7d2c5.
>>java.lang.NoClassDefFoundError: core
>>
>>
>>
>>看日志是在部分task里面报错
Re:flink 通过 --classpath 传入https-xxx.xxx.jar 在1.8上正常运行 在flink1.10 就会报传入的jar包找不到
Posted by Weixubin <18...@163.com>.
和版本应该没什么关系。如果是多节点部署的情况下，-C 所指定的URL 需要各个节点都能访问得到。 确认下该URL能被所有节点访问到吗
Best,
Bin
At 2020-06-22 11:43:11, "程龙" <13...@163.com> wrote:
>2020-06-22 10:16:34,379 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from SCHEDULED to DEPLOYING.
>2020-06-22 10:16:34,379 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Sink: Unnamed (6/6) (attempt #0) to container_1590655249980_0081_01_000002 @ al-bj-bigdata-inf-research-flink04 (dataPort=34781)
>2020-06-22 10:16:34,456 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (5/6) (aca298438b9eb6fcf295cb8af6eebcd8) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,481 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,492 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (1/6) (44ca248aba351026452ba4abdb5f33a6) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,497 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (1/8) (70612735eb755269fe9590e8ab51d3e2) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,512 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (2/8) (baba331cd6bcde1f5a6024eac0b953b4) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,524 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (4/6) (a34992362c2cf3634a29bd5a9c188754) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,531 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (2/6) (7683c15e3ebb3e718c2439c6e32f0d7d) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,564 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (6/6) (6ab1aaa5e1811c79c702197f984e9bb6) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,609 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (1/6) (6245b508b8e0494f06ef71c6ad4954b6) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,616 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (4/8) (2ea049476f0b48fcd85dcd9084091e9f) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,650 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (2/6) (e785e44e4212dcc5279bcde761b28292) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,656 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (5/6) (97a5e72f731d14aa97d93253b71b6aeb) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,662 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (7/8) (59babdbc2d7bea362a2794a966fe59ef) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,664 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Custom Source (3/6) (aed33b78cc847561908ea43164e0311a) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,669 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (6/8) (fd87d0111b10e9f9027068a72e9ce209) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,726 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,729 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (8/8) (22b73fa7f7435a405e1102a3480c09c1) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:34,760 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (4/6) (4c677579ef44cf394618af38a75497da) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:37,081 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 1 @ 1592792197072 for job 1797e2f64b7b1caeb6356608290263cc.
>2020-06-22 10:16:45,065 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: Unnamed (3/6) (d9a9c913dcbf782bd933b0adae157b38) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:45,066 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (5/8) (39dbdd04e2066d1d93be1641c0ab7add) switched from DEPLOYING to RUNNING.
>2020-06-22 10:16:48,512 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter -> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from RUNNING to FAILED on org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot@25d7d2c5.
>java.lang.NoClassDefFoundError: core
>
>
>
>看日志是在部分task里面报错
Re:Re: flink 通过 --classpath 传入https-xxx.xxx.jar 在1.8上正常运行 在flink1.10 就会报传入的jar包找不到
Posted by 程龙 <13...@163.com>.
在同一套集群离 安装有连个版本的flink 使用-C http://xxx.jar的方式 1.8能正常运行 说明都能访问 使用1.10 就不行
At 2020-06-22 17:46:56, "Yang Wang" <da...@gmail.com> wrote:
> -C,--classpath <url> Adds a URL to each user code
> classloader on all nodes in the
> cluster. The paths must specify a
> protocol (e.g. file://) and be
> accessible on all nodes (e.g. by
>means
> of a NFS share). You can use this
> option multiple times for
>specifying
> more than one URL. The protocol
>must
> be supported by the {@link
> java.net.URLClassLoader}.
>
>
>--classpath这个参数需要提前将jar部署在各个节点上或者使用NFS，确认jar是存在的吗
>
>
>Best,
>Yang
>
>程龙 <13...@163.com> 于2020年6月22日周一 上午11:43写道：
>
>> 2020-06-22 10:16:34,379 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
>> Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from SCHEDULED to
>> DEPLOYING.
>> 2020-06-22 10:16:34,379 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying
>> Sink: Unnamed (6/6) (attempt #0) to container_1590655249980_0081_01_000002
>> @ al-bj-bigdata-inf-research-flink04 (dataPort=34781)
>> 2020-06-22 10:16:34,456 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
>> Custom Source (5/6) (aca298438b9eb6fcf295cb8af6eebcd8) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,481 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
>> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,492 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
>> Unnamed (1/6) (44ca248aba351026452ba4abdb5f33a6) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,497 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
>> Map (1/8) (70612735eb755269fe9590e8ab51d3e2) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,512 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
>> Map (2/8) (baba331cd6bcde1f5a6024eac0b953b4) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,524 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
>> Custom Source (4/6) (a34992362c2cf3634a29bd5a9c188754) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,531 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
>> Custom Source (2/6) (7683c15e3ebb3e718c2439c6e32f0d7d) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,564 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
>> Custom Source (6/6) (6ab1aaa5e1811c79c702197f984e9bb6) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,609 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
>> Custom Source (1/6) (6245b508b8e0494f06ef71c6ad4954b6) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,616 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
>> Map (4/8) (2ea049476f0b48fcd85dcd9084091e9f) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,650 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
>> Unnamed (2/6) (e785e44e4212dcc5279bcde761b28292) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,656 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
>> Unnamed (5/6) (97a5e72f731d14aa97d93253b71b6aeb) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,662 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
>> Map (7/8) (59babdbc2d7bea362a2794a966fe59ef) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,664 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
>> Custom Source (3/6) (aed33b78cc847561908ea43164e0311a) switched from
>> DEPLOYING to RUNNING.
>> 2020-06-22 10:16:34,669 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
>> Map (6/8) (fd87d0111b10e9f9027068a72e9ce209) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,726 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
>> Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,729 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
>> Map (8/8) (22b73fa7f7435a405e1102a3480c09c1) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:34,760 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
>> Unnamed (4/6) (4c677579ef44cf394618af38a75497da) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:37,081 INFO
>> org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering
>> checkpoint 1 @ 1592792197072 for job 1797e2f64b7b1caeb6356608290263cc.
>> 2020-06-22 10:16:45,065 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
>> Unnamed (3/6) (d9a9c913dcbf782bd933b0adae157b38) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:45,066 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
>> Map (5/8) (39dbdd04e2066d1d93be1641c0ab7add) switched from DEPLOYING to
>> RUNNING.
>> 2020-06-22 10:16:48,512 INFO
>> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
>> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from RUNNING to
>> FAILED on
>> org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot@25d7d2c5.
>> java.lang.NoClassDefFoundError: core
>>
>>
>>
>> 看日志是在部分task里面报错
Re: flink 通过 --classpath 传入https-xxx.xxx.jar 在1.8上正常运行 在flink1.10 就会报传入的jar包找不到
Posted by Yang Wang <da...@gmail.com>.
-C,--classpath <url> Adds a URL to each user code
classloader on all nodes in the
cluster. The paths must specify a
protocol (e.g. file://) and be
accessible on all nodes (e.g. by
means
of a NFS share). You can use this
option multiple times for
specifying
more than one URL. The protocol
must
be supported by the {@link
java.net.URLClassLoader}.
--classpath这个参数需要提前将jar部署在各个节点上或者使用NFS，确认jar是存在的吗
Best,
Yang
程龙 <13...@163.com> 于2020年6月22日周一 上午11:43写道：
> 2020-06-22 10:16:34,379 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
> Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from SCHEDULED to
> DEPLOYING.
> 2020-06-22 10:16:34,379 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying
> Sink: Unnamed (6/6) (attempt #0) to container_1590655249980_0081_01_000002
> @ al-bj-bigdata-inf-research-flink04 (dataPort=34781)
> 2020-06-22 10:16:34,456 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
> Custom Source (5/6) (aca298438b9eb6fcf295cb8af6eebcd8) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,481 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,492 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
> Unnamed (1/6) (44ca248aba351026452ba4abdb5f33a6) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,497 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
> Map (1/8) (70612735eb755269fe9590e8ab51d3e2) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,512 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
> Map (2/8) (baba331cd6bcde1f5a6024eac0b953b4) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,524 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
> Custom Source (4/6) (a34992362c2cf3634a29bd5a9c188754) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,531 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
> Custom Source (2/6) (7683c15e3ebb3e718c2439c6e32f0d7d) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,564 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
> Custom Source (6/6) (6ab1aaa5e1811c79c702197f984e9bb6) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,609 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
> Custom Source (1/6) (6245b508b8e0494f06ef71c6ad4954b6) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,616 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
> Map (4/8) (2ea049476f0b48fcd85dcd9084091e9f) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,650 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
> Unnamed (2/6) (e785e44e4212dcc5279bcde761b28292) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,656 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
> Unnamed (5/6) (97a5e72f731d14aa97d93253b71b6aeb) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,662 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
> Map (7/8) (59babdbc2d7bea362a2794a966fe59ef) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,664 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Source:
> Custom Source (3/6) (aed33b78cc847561908ea43164e0311a) switched from
> DEPLOYING to RUNNING.
> 2020-06-22 10:16:34,669 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
> Map (6/8) (fd87d0111b10e9f9027068a72e9ce209) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,726 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
> Unnamed (6/6) (5dd98ec92e0d5e53597cb7520643c7f5) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,729 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
> Map (8/8) (22b73fa7f7435a405e1102a3480c09c1) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:34,760 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
> Unnamed (4/6) (4c677579ef44cf394618af38a75497da) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:37,081 INFO
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering
> checkpoint 1 @ 1592792197072 for job 1797e2f64b7b1caeb6356608290263cc.
> 2020-06-22 10:16:45,065 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink:
> Unnamed (3/6) (d9a9c913dcbf782bd933b0adae157b38) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:45,066 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
> Map (5/8) (39dbdd04e2066d1d93be1641c0ab7add) switched from DEPLOYING to
> RUNNING.
> 2020-06-22 10:16:48,512 INFO
> org.apache.flink.runtime.executiongraph.ExecutionGraph - Filter ->
> Map (3/8) (0daed15d107c3031891f0c9e84093068) switched from RUNNING to
> FAILED on
> org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot@25d7d2c5.
> java.lang.NoClassDefFoundError: core
>
>
>
> 看日志是在部分task里面报错