You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by GitBox <gi...@apache.org> on 2020/10/15 09:09:18 UTC
[GitHub] [kylin] chenjie-sau opened a new pull request #1451: [KYLIN-4736]Upgrade Flink version to 1.11.1
chenjie-sau opened a new pull request #1451:
URL: https://github.com/apache/kylin/pull/1451
## Proposed changes
Upgrade Flink version to 1.11.1.
## Types of changes
What types of changes does your code introduce to Kylin?
_Put an `x` in the boxes that apply_
- [ ] Bugfix (non-breaking change which fixes an issue)
- [ ] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
- [ ] Documentation Update (if none of the other choices apply)
## Checklist
_Put an `x` in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code._
- [ ] I have create an issue on [Kylin's jira](https://issues.apache.org/jira/browse/KYLIN), and have described the bug/feature there in detail
- [ ] Commit messages in my PR start with the related jira ID, like "KYLIN-0000 Make Kylin project open-source"
- [ ] Compiling and unit tests pass locally with my changes
- [ ] I have added tests that prove my fix is effective or that my feature works
- [ ] If this change need a document change, I will prepare another pr against the `document` branch
- [ ] Any dependent changes have been merged
## Further comments
If this is a relatively large or complex change, kick off the discussion at user@kylin or dev@kylin by explaining why you chose the solution you did and what alternatives you considered, etc...
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] zhangayqian edited a comment on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
zhangayqian edited a comment on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-712539924
@chenjie-sau. My cdh version is cdh57. Maybe there are some differences between them.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] chenjie-sau closed pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
chenjie-sau closed pull request #1451:
URL: https://github.com/apache/kylin/pull/1451
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] zhangayqian commented on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
zhangayqian commented on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-713238350
@chenjie-sau Hi, I replaced flink-shaded-hadoop-3-uber-3.1.1.7.1.1.0-565-9.0.jar in the flink/lib directory with flink-shaded-hadoop-2-uber-2.7.5-10.0.jar and restart kylin, but it not work. The same error is still reported.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] zhangayqian edited a comment on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
zhangayqian edited a comment on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-712539924
@chenjie-sau. My cdh version is cdh57. Maybe there are some differences between hadoop2 and hadoop3.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] chenjie-sau closed pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
chenjie-sau closed pull request #1451:
URL: https://github.com/apache/kylin/pull/1451
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] chenjie-sau edited a comment on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
chenjie-sau edited a comment on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-713249083
> @chenjie-sau Hi, I replaced flink-shaded-hadoop-3-uber-3.1.1.7.1.1.0-565-9.0.jar in the flink/lib directory with flink-shaded-hadoop-2-uber-2.7.5-10.0.jar and restart kylin, but it not work. The same error is still reported.
@zhangayqian The exception is thrown by mr engine，Try to modify core-site.xml,
<property>
<name>fs.hdfs.impl.disable.cache</name>
<value>true</value>
</property>
and try again，Trouble you
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] zhangayqian edited a comment on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
zhangayqian edited a comment on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-709952465
I tested this branch in my local env. I use the $KYLIN_HOME/bin/download-flink.sh download Flink 1.11.1. Then I start kylin and submit a Flink build job. But there is a error in step `Build cube with flink`. The error information is as follows:
```
------------------------------------------------------------
The program finished with the following exception:
org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: error execute org.apache.kylin.engine.flink.FlinkCubingByLayer. Root cause: Filesystem closed
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:302)
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198)
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:149)
at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:699)
at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:232)
at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:916)
at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:992)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:992)
Caused by: java.lang.RuntimeException: error execute org.apache.kylin.engine.flink.FlinkCubingByLayer. Root cause: Filesystem closed
at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42)
at org.apache.kylin.common.util.FlinkEntry.main(FlinkEntry.java:46)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:288)
... 11 more
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:476)
at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1683)
at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1714)
at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1711)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1726)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1718)
at org.apache.kylin.engine.mr.JobBuilderSupport.scanFiles(JobBuilderSupport.java:495)
at org.apache.kylin.engine.mr.JobBuilderSupport.getFileSize(JobBuilderSupport.java:510)
at org.apache.kylin.engine.flink.FlinkCubingByLayer.execute(FlinkCubingByLayer.java:212)
at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37)
... 17 more
The command is:
export HADOOP_CONF_DIR=/etc/hadoop/conf && export HADOOP_CLASSPATH=/etc/hadoop && /root/zhangyaqian/tar/apache-kylin-3.1.2-SNAPSHOT-bin/flink/bin/flink run -m yarn-cluster -yjm 2G -ys 1 -ytm 4G -ynm Build-Cube-with-Flink:kylin_sales_cube_clone[20120101000000_20120201000000] -c org.apache.kylin.common.util.FlinkEntry -p 1 /root/zhangyaqian/tar/apache-kylin-3.1.2-SNAPSHOT-bin/lib/kylin-job-3.1.2-SNAPSHOT.jar -className org.apache.kylin.engine.flink.FlinkCubingByLayer -hiveTable default.kylin_intermediate_kylin_sales_cube_clone_3ca685b1_049d_4377_9c9f_1698e0cbcbc6 -output hdfs://cdh-master:8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_sales_cube_clone/cuboid/ -input hdfs://cdh-master:8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_intermediate_kylin_sales_cube_clone_3ca685b1_049d_4377_9c9f_1698e0cbcbc6 -enableObjectReuse false -segmentId 3ca685b1-049d-4377-9c9f-1698e0cbcbc6 -metaUrl kylin_zyq@hdfs,path=hdfs://cdh-master:80
20/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_sales_cube_clone/metadata -cubename kylin_sales_cube_clone
at org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:96)
at org.apache.kylin.engine.flink.FlinkExecutable.lambda$doWork$1(FlinkExecutable.java:246)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2020-10-16 14:23:39,537 INFO [Scheduler 737950975 Job 44637f80-4271-4dcd-0fb2-f673a418b80e-123] execution.ExecutableManager:485 : job id:44637f80-4271-4dcd-0fb2-f673a418b80e-06 from RUNNING to ERROR
2020-10-16 14:23:39,553 INFO [Scheduler 737950975 Job 44637f80-4271-4dcd-0fb2-f673a418b80e-123] execution.ExecutableManager:485 : job id:44637f80-4271-4dcd-0fb2-f673a418b80e from RUNNING to ERROR
```
@chenjie-sau Do you know the reason for this error?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] chenjie-sau edited a comment on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
chenjie-sau edited a comment on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-713249083
> @chenjie-sau Hi, I replaced flink-shaded-hadoop-3-uber-3.1.1.7.1.1.0-565-9.0.jar in the flink/lib directory with flink-shaded-hadoop-2-uber-2.7.5-10.0.jar and restart kylin, but it not work. The same error is still reported.
@zhangayqian I am looking for a verification of the same environment for this issue, thank you
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] zhangayqian commented on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
zhangayqian commented on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-709952465
I test this branch in my local env. I use the $KYLIN_HOME/bin/download-flink.sh download Flink 1.11.1. Then I start kylin and submit a Flink build job. But there is a error in step `Build cube with flink`. The error information is as follows:
```
------------------------------------------------------------
The program finished with the following exception:
org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: error execute org.apache.kylin.engine.flink.FlinkCubingByLayer. Root cause: Filesystem closed
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:302)
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198)
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:149)
at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:699)
at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:232)
at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:916)
at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:992)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:992)
Caused by: java.lang.RuntimeException: error execute org.apache.kylin.engine.flink.FlinkCubingByLayer. Root cause: Filesystem closed
at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42)
at org.apache.kylin.common.util.FlinkEntry.main(FlinkEntry.java:46)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:288)
... 11 more
Caused by: java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:476)
at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1683)
at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1714)
at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1711)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1726)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1718)
at org.apache.kylin.engine.mr.JobBuilderSupport.scanFiles(JobBuilderSupport.java:495)
at org.apache.kylin.engine.mr.JobBuilderSupport.getFileSize(JobBuilderSupport.java:510)
at org.apache.kylin.engine.flink.FlinkCubingByLayer.execute(FlinkCubingByLayer.java:212)
at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37)
... 17 more
The command is:
export HADOOP_CONF_DIR=/etc/hadoop/conf && export HADOOP_CLASSPATH=/etc/hadoop && /root/zhangyaqian/tar/apache-kylin-3.1.2-SNAPSHOT-bin/flink/bin/flink run -m yarn-cluster -yjm 2G -ys 1 -ytm 4G -ynm Build-Cube-with-Flink:kylin_sales_cube_clone[20120101000000_20120201000000] -c org.apache.kylin.common.util.FlinkEntry -p 1 /root/zhangyaqian/tar/apache-kylin-3.1.2-SNAPSHOT-bin/lib/kylin-job-3.1.2-SNAPSHOT.jar -className org.apache.kylin.engine.flink.FlinkCubingByLayer -hiveTable default.kylin_intermediate_kylin_sales_cube_clone_3ca685b1_049d_4377_9c9f_1698e0cbcbc6 -output hdfs://cdh-master:8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_sales_cube_clone/cuboid/ -input hdfs://cdh-master:8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_intermediate_kylin_sales_cube_clone_3ca685b1_049d_4377_9c9f_1698e0cbcbc6 -enableObjectReuse false -segmentId 3ca685b1-049d-4377-9c9f-1698e0cbcbc6 -metaUrl kylin_zyq@hdfs,path=hdfs://cdh-master:80
20/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_sales_cube_clone/metadata -cubename kylin_sales_cube_clone
at org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:96)
at org.apache.kylin.engine.flink.FlinkExecutable.lambda$doWork$1(FlinkExecutable.java:246)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2020-10-16 14:23:39,537 INFO [Scheduler 737950975 Job 44637f80-4271-4dcd-0fb2-f673a418b80e-123] execution.ExecutableManager:485 : job id:44637f80-4271-4dcd-0fb2-f673a418b80e-06 from RUNNING to ERROR
2020-10-16 14:23:39,553 INFO [Scheduler 737950975 Job 44637f80-4271-4dcd-0fb2-f673a418b80e-123] execution.ExecutableManager:485 : job id:44637f80-4271-4dcd-0fb2-f673a418b80e from RUNNING to ERROR
```
@chenjie-sau Do you know the reason for this error?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] yanghua commented on pull request #1451: [KYLIN-4736]Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
yanghua commented on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-709084972
> Hi @yanghua could you please take a look when free
OK, thanks for your contribution. Will review soon.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] coveralls commented on pull request #1451: [KYLIN-4736]Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
coveralls commented on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-709053644
## Pull Request Test Coverage Report for [Build 6459](https://coveralls.io/builds/34193505)
* **2** of **2** **(100.0%)** changed or added relevant lines in **1** file are covered.
* **6** unchanged lines in **4** files lost coverage.
* Overall coverage decreased (**-0.004%**) to **28.047%**
---
| Files with Coverage Reduction | New Missed Lines | % |
| :-----|--------------|--: |
| [core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/34193505/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L553) | 1 | 78.12% |
| [tool/src/main/java/org/apache/kylin/tool/query/ProbabilityGenerator.java](https://coveralls.io/builds/34193505/source?filename=tool%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Ftool%2Fquery%2FProbabilityGenerator.java#L42) | 1 | 81.58% |
| [core-cube/src/main/java/org/apache/kylin/cube/cuboid/TreeCuboidScheduler.java](https://coveralls.io/builds/34193505/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Fcuboid%2FTreeCuboidScheduler.java#L124) | 2 | 68.46% |
| [stream-core/src/main/java/org/apache/kylin/stream/core/storage/CheckPointStore.java](https://coveralls.io/builds/34193505/source?filename=stream-core%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstream%2Fcore%2Fstorage%2FCheckPointStore.java#L98) | 2 | 73.74% |
<!-- | **Total:** | **6** | | -->
| Totals | [](https://coveralls.io/builds/34193505) |
| :-- | --: |
| Change from base [Build 6452](https://coveralls.io/builds/34141224): | -0.004% |
| Covered Lines: | 26250 |
| Relevant Lines: | 93592 |
---
##### 💛 - [Coveralls](https://coveralls.io)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] chenjie-sau commented on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
chenjie-sau commented on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-712248999
> I tested this branch in my local env. I use the $KYLIN_HOME/bin/download-flink.sh download Flink 1.11.1. Then I start kylin and submit a Flink build job. But there is a error in step `Build cube with flink`. The error information is as follows:
>
> ```
> ------------------------------------------------------------
> The program finished with the following exception:
>
> org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: error execute org.apache.kylin.engine.flink.FlinkCubingByLayer. Root cause: Filesystem closed
> at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:302)
> at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198)
> at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:149)
> at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:699)
> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:232)
> at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:916)
> at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:992)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
> at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:992)
> Caused by: java.lang.RuntimeException: error execute org.apache.kylin.engine.flink.FlinkCubingByLayer. Root cause: Filesystem closed
> at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42)
> at org.apache.kylin.common.util.FlinkEntry.main(FlinkEntry.java:46)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:288)
> ... 11 more
> Caused by: java.io.IOException: Filesystem closed
> at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:476)
> at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1683)
> at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1714)
> at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1711)
> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1726)
> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1718)
> at org.apache.kylin.engine.mr.JobBuilderSupport.scanFiles(JobBuilderSupport.java:495)
> at org.apache.kylin.engine.mr.JobBuilderSupport.getFileSize(JobBuilderSupport.java:510)
> at org.apache.kylin.engine.flink.FlinkCubingByLayer.execute(FlinkCubingByLayer.java:212)
> at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37)
> ... 17 more
> The command is:
> export HADOOP_CONF_DIR=/etc/hadoop/conf && export HADOOP_CLASSPATH=/etc/hadoop && /root/zhangyaqian/tar/apache-kylin-3.1.2-SNAPSHOT-bin/flink/bin/flink run -m yarn-cluster -yjm 2G -ys 1 -ytm 4G -ynm Build-Cube-with-Flink:kylin_sales_cube_clone[20120101000000_20120201000000] -c org.apache.kylin.common.util.FlinkEntry -p 1 /root/zhangyaqian/tar/apache-kylin-3.1.2-SNAPSHOT-bin/lib/kylin-job-3.1.2-SNAPSHOT.jar -className org.apache.kylin.engine.flink.FlinkCubingByLayer -hiveTable default.kylin_intermediate_kylin_sales_cube_clone_3ca685b1_049d_4377_9c9f_1698e0cbcbc6 -output hdfs://cdh-master:8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_sales_cube_clone/cuboid/ -input hdfs://cdh-master:8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_intermediate_kylin_sales_cube_clone_3ca685b1_049d_4377_9c9f_1698e0cbcbc6 -enableObjectReuse false -segmentId 3ca685b1-049d-4377-9c9f-1698e0cbcbc6 -metaUrl kylin_zyq@hdfs,path=hdfs://cdh-master:
8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_sales_cube_clone/metadata -cubename kylin_sales_cube_clone
> at org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:96)
> at org.apache.kylin.engine.flink.FlinkExecutable.lambda$doWork$1(FlinkExecutable.java:246)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> 2020-10-16 14:23:39,537 INFO [Scheduler 737950975 Job 44637f80-4271-4dcd-0fb2-f673a418b80e-123] execution.ExecutableManager:485 : job id:44637f80-4271-4dcd-0fb2-f673a418b80e-06 from RUNNING to ERROR
> 2020-10-16 14:23:39,553 INFO [Scheduler 737950975 Job 44637f80-4271-4dcd-0fb2-f673a418b80e-123] execution.ExecutableManager:485 : job id:44637f80-4271-4dcd-0fb2-f673a418b80e from RUNNING to ERROR
> ```
>
> @chenjie-sau Do you know the reason for this error?
@zhangayqian What is the version of cdh you are using， my env cdh version is cdh6, build cube with flink is success
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] zhangayqian commented on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
zhangayqian commented on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-712539924
My cdh version is cdh57. Maybe there are some differences between them.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] chenjie-sau commented on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
chenjie-sau commented on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-713249083
> @chenjie-sau Hi, I replaced flink-shaded-hadoop-3-uber-3.1.1.7.1.1.0-565-9.0.jar in the flink/lib directory with flink-shaded-hadoop-2-uber-2.7.5-10.0.jar and restart kylin, but it not work. The same error is still reported.
@zhangayqian I make a retest in the same environment, thank you
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] chenjie-sau commented on pull request #1451: [KYLIN-4736]Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
chenjie-sau commented on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-709023361
Hi @yanghua could you please take a look when free
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] zhangayqian commented on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
zhangayqian commented on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-709696291
> @chenjie-sau Thanks for your contribution. @zhangayqian Do you have any concerns? Or do you want to verify it? @chenjie-sau has verified in his local env.
Thank you @yanghua . I will verify it later in my env.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] chenjie-sau commented on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
chenjie-sau commented on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-712552968
> @chenjie-sau. My cdh version is cdh57. Maybe there are some differences between hadoop2 and hadoop3.
@zhangayqian You can replace flink-shaded-hadoop-3-uber-3.1.1.7.1.1.0-565-9.0.jar in the flink/lib directory with flink-shaded-hadoop-2-uber-2.7.5-10.0.jar, The download address of flink-shaded-hadoop-2-uber-2.7.5-10.0.jar is https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.7.5-10.0/flink-shaded-hadoop-2-uber-2.7.5-10.0.jar， and try again，Trouble you
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] chenjie-sau removed a comment on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
chenjie-sau removed a comment on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-712538067
> I tested this branch in my local env. I use the $KYLIN_HOME/bin/download-flink.sh download Flink 1.11.1. Then I start kylin and submit a Flink build job. But there is a error in step `Build cube with flink`. The error information is as follows:
>
> ```
> ------------------------------------------------------------
> The program finished with the following exception:
>
> org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: error execute org.apache.kylin.engine.flink.FlinkCubingByLayer. Root cause: Filesystem closed
> at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:302)
> at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198)
> at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:149)
> at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:699)
> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:232)
> at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:916)
> at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:992)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
> at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:992)
> Caused by: java.lang.RuntimeException: error execute org.apache.kylin.engine.flink.FlinkCubingByLayer. Root cause: Filesystem closed
> at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42)
> at org.apache.kylin.common.util.FlinkEntry.main(FlinkEntry.java:46)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:288)
> ... 11 more
> Caused by: java.io.IOException: Filesystem closed
> at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:476)
> at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1683)
> at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1714)
> at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1711)
> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1726)
> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1718)
> at org.apache.kylin.engine.mr.JobBuilderSupport.scanFiles(JobBuilderSupport.java:495)
> at org.apache.kylin.engine.mr.JobBuilderSupport.getFileSize(JobBuilderSupport.java:510)
> at org.apache.kylin.engine.flink.FlinkCubingByLayer.execute(FlinkCubingByLayer.java:212)
> at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37)
> ... 17 more
> The command is:
> export HADOOP_CONF_DIR=/etc/hadoop/conf && export HADOOP_CLASSPATH=/etc/hadoop && /root/zhangyaqian/tar/apache-kylin-3.1.2-SNAPSHOT-bin/flink/bin/flink run -m yarn-cluster -yjm 2G -ys 1 -ytm 4G -ynm Build-Cube-with-Flink:kylin_sales_cube_clone[20120101000000_20120201000000] -c org.apache.kylin.common.util.FlinkEntry -p 1 /root/zhangyaqian/tar/apache-kylin-3.1.2-SNAPSHOT-bin/lib/kylin-job-3.1.2-SNAPSHOT.jar -className org.apache.kylin.engine.flink.FlinkCubingByLayer -hiveTable default.kylin_intermediate_kylin_sales_cube_clone_3ca685b1_049d_4377_9c9f_1698e0cbcbc6 -output hdfs://cdh-master:8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_sales_cube_clone/cuboid/ -input hdfs://cdh-master:8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_intermediate_kylin_sales_cube_clone_3ca685b1_049d_4377_9c9f_1698e0cbcbc6 -enableObjectReuse false -segmentId 3ca685b1-049d-4377-9c9f-1698e0cbcbc6 -metaUrl kylin_zyq@hdfs,path=hdfs://cdh-master:
8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_sales_cube_clone/metadata -cubename kylin_sales_cube_clone
> at org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:96)
> at org.apache.kylin.engine.flink.FlinkExecutable.lambda$doWork$1(FlinkExecutable.java:246)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> 2020-10-16 14:23:39,537 INFO [Scheduler 737950975 Job 44637f80-4271-4dcd-0fb2-f673a418b80e-123] execution.ExecutableManager:485 : job id:44637f80-4271-4dcd-0fb2-f673a418b80e-06 from RUNNING to ERROR
> 2020-10-16 14:23:39,553 INFO [Scheduler 737950975 Job 44637f80-4271-4dcd-0fb2-f673a418b80e-123] execution.ExecutableManager:485 : job id:44637f80-4271-4dcd-0fb2-f673a418b80e from RUNNING to ERROR
> ```
>
> @chenjie-sau Do you know the reason for this error?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] coveralls edited a comment on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
coveralls edited a comment on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-709053644
## Pull Request Test Coverage Report for [Build 6469](https://coveralls.io/builds/34302139)
* **2** of **2** **(100.0%)** changed or added relevant lines in **1** file are covered.
* **22** unchanged lines in **3** files lost coverage.
* Overall coverage decreased (**-0.001%**) to **28.05%**
---
| Files with Coverage Reduction | New Missed Lines | % |
| :-----|--------------|--: |
| [tool/src/main/java/org/apache/kylin/tool/query/ProbabilityGenerator.java](https://coveralls.io/builds/34302139/source?filename=tool%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Ftool%2Fquery%2FProbabilityGenerator.java#L42) | 1 | 81.58% |
| [core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/34302139/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L439) | 5 | 77.81% |
| [stream-core/src/main/java/org/apache/kylin/stream/core/query/MultiThreadsResultCollector.java](https://coveralls.io/builds/34302139/source?filename=stream-core%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstream%2Fcore%2Fquery%2FMultiThreadsResultCollector.java#L94) | 16 | 73.96% |
<!-- | **Total:** | **22** | | -->
| Totals | [](https://coveralls.io/builds/34302139) |
| :-- | --: |
| Change from base [Build 6452](https://coveralls.io/builds/34141224): | -0.001% |
| Covered Lines: | 26254 |
| Relevant Lines: | 93598 |
---
##### 💛 - [Coveralls](https://coveralls.io)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [kylin] chenjie-sau commented on pull request #1451: KYLIN-4736 Upgrade Flink version to 1.11.1
Posted by GitBox <gi...@apache.org>.
chenjie-sau commented on pull request #1451:
URL: https://github.com/apache/kylin/pull/1451#issuecomment-712538067
> I tested this branch in my local env. I use the $KYLIN_HOME/bin/download-flink.sh download Flink 1.11.1. Then I start kylin and submit a Flink build job. But there is a error in step `Build cube with flink`. The error information is as follows:
>
> ```
> ------------------------------------------------------------
> The program finished with the following exception:
>
> org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: error execute org.apache.kylin.engine.flink.FlinkCubingByLayer. Root cause: Filesystem closed
> at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:302)
> at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198)
> at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:149)
> at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:699)
> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:232)
> at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:916)
> at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:992)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
> at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:992)
> Caused by: java.lang.RuntimeException: error execute org.apache.kylin.engine.flink.FlinkCubingByLayer. Root cause: Filesystem closed
> at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42)
> at org.apache.kylin.common.util.FlinkEntry.main(FlinkEntry.java:46)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:288)
> ... 11 more
> Caused by: java.io.IOException: Filesystem closed
> at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:476)
> at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1683)
> at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1714)
> at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1711)
> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1726)
> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1718)
> at org.apache.kylin.engine.mr.JobBuilderSupport.scanFiles(JobBuilderSupport.java:495)
> at org.apache.kylin.engine.mr.JobBuilderSupport.getFileSize(JobBuilderSupport.java:510)
> at org.apache.kylin.engine.flink.FlinkCubingByLayer.execute(FlinkCubingByLayer.java:212)
> at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37)
> ... 17 more
> The command is:
> export HADOOP_CONF_DIR=/etc/hadoop/conf && export HADOOP_CLASSPATH=/etc/hadoop && /root/zhangyaqian/tar/apache-kylin-3.1.2-SNAPSHOT-bin/flink/bin/flink run -m yarn-cluster -yjm 2G -ys 1 -ytm 4G -ynm Build-Cube-with-Flink:kylin_sales_cube_clone[20120101000000_20120201000000] -c org.apache.kylin.common.util.FlinkEntry -p 1 /root/zhangyaqian/tar/apache-kylin-3.1.2-SNAPSHOT-bin/lib/kylin-job-3.1.2-SNAPSHOT.jar -className org.apache.kylin.engine.flink.FlinkCubingByLayer -hiveTable default.kylin_intermediate_kylin_sales_cube_clone_3ca685b1_049d_4377_9c9f_1698e0cbcbc6 -output hdfs://cdh-master:8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_sales_cube_clone/cuboid/ -input hdfs://cdh-master:8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_intermediate_kylin_sales_cube_clone_3ca685b1_049d_4377_9c9f_1698e0cbcbc6 -enableObjectReuse false -segmentId 3ca685b1-049d-4377-9c9f-1698e0cbcbc6 -metaUrl kylin_zyq@hdfs,path=hdfs://cdh-master:
8020/kylin/yaqian/kylin_zyq/kylin-44637f80-4271-4dcd-0fb2-f673a418b80e/kylin_sales_cube_clone/metadata -cubename kylin_sales_cube_clone
> at org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:96)
> at org.apache.kylin.engine.flink.FlinkExecutable.lambda$doWork$1(FlinkExecutable.java:246)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> 2020-10-16 14:23:39,537 INFO [Scheduler 737950975 Job 44637f80-4271-4dcd-0fb2-f673a418b80e-123] execution.ExecutableManager:485 : job id:44637f80-4271-4dcd-0fb2-f673a418b80e-06 from RUNNING to ERROR
> 2020-10-16 14:23:39,553 INFO [Scheduler 737950975 Job 44637f80-4271-4dcd-0fb2-f673a418b80e-123] execution.ExecutableManager:485 : job id:44637f80-4271-4dcd-0fb2-f673a418b80e from RUNNING to ERROR
> ```
>
> @chenjie-sau Do you know the reason for this error?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org