You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@linkis.apache.org by "Captain02 (via GitHub)" <gi...@apache.org> on 2023/02/23 14:21:06 UTC
[GitHub] [linkis] Captain02 opened a new issue, #4260: [Question]The first upload of the resource failed.
Captain02 opened a new issue, #4260:
URL: https://github.com/apache/linkis/issues/4260
### Before asking
- [X] I have read the [How to ask for help](https://linkis.apache.org/community/how-to-ask-for-help) (我已阅读[如何寻求帮助](https://linkis.apache.org/zh-CN/community/how-to-ask-for-help)指引文档).
### Your environment
<!-- Please describe the linkis version you are using and basic environment information -->
<!-- 请描述您使用的linkis版本和基本环境信息 -->
- Linkis version used: 1.3.1
- Environment name and version:
- hdp-3.1.3
- hive-3.1.3
- scala-2.12.11
- jdk 1.8.0_121
- ....
### Describe your questions
<!-- Please describe your questions -->
<!-- 请描述您的问题 -->
Q1.When starting the project for the first time, the linkis-ps-publicservice report an error
### Eureka service list
<!-- You can directly copy and paste the screenshot of the list of registered service instances displayed on the Eureka page here -->
<!-- 可以将Eureka页面显示的注册服务实例列表的的截图 直接复制并粘贴到这里。 粘贴后，会自动生成如下格式的url-->
### Some logs info or acctch file
<!-- Please add the log in the following format, the key error log must be pasted in the code style, and the text as much as possible, the detailed log or other files can be dragged and uploaded as an attachment -->
<!-- 请按如下格式 添加日志，关键错误日志请贴到[````log][````]之间，尽可能贴文字，详细日志或则其它文件，可以拖拽上传作为附件 -->
linkis-ps-publicservice.log:
````log
2023-02-23 21:33:50.909 [WARN ] [qtp1088034372-24 ] o.a.h.f.FSInputChecker (165) [<init>] - Problem opening checksum file: /tmp/linkis/ltz1/bml/20230223/b8d83f60-cf6b-45a3-abf4-a373a13cb977. Ignoring exception: java.io.EOFException: null
at java.io.DataInputStream.readFully(DataInputStream.java:197) ~[?:1.8.0_212]
at java.io.DataInputStream.readFully(DataInputStream.java:169) ~[?:1.8.0_212]
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:155) ~[hadoop-common-3.1.1.jar:?]
......
2023-02-23 21:33:54.330 [INFO ] [qtp1088034372-20 ] o.a.h.f.FSInputChecker (309) [readChecksumChunk] - Found checksum error: b[0, 0]= org.apache.hadoop.fs.ChecksumException: Checksum error: /tmp/linkis/ltz1/bml/20230223/013de473-cf31-4197-a012-e85a3e2f2d0f at 82836480
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.readChunk(ChecksumFileSystem.java:260) ~[hadoop-common-3.1.1.jar:?]
......
2023-02-23 21:33:54.332 [ERROR] [qtp1088034372-20 ] o.a.l.b.c.HdfsResourceHelper (97) [upload] - ltz1 write to hdfs://hdfs:///tmp/linkis/ltz1/bml/20230223/013de473-cf31-4197-a012-e85a3e2f2d0f failed, reason is, IOException: org.apache.hadoop.fs.ChecksumException: Checksum error: /tmp/linkis/ltz1/bml/20230223/013de473-cf31-4197-a012-e85a3e2f2d0f at 82836480
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.readChunk(ChecksumFileSystem.java:260) ~[hadoop-common-3.1.1.jar:?]
......
2023-02-23 21:33:54.338 [ERROR] [qtp1088034372-20 ] o.a.l.b.s.i.TaskServiceImpl (114) [createUploadTask] - Upload resource successfully. Update task (上传资源失败.更新任务) taskId:2-resourceId:013de473-cf31-4197-a012-e85a3e2f2d0f status is failed . org.apache.linkis.bml.common.UploadResourceException: errCode: 60050 ,desc: The first upload of the resource failed(首次上传资源失败) ,ip: hadoop102 ,port: 9105 ,serviceKind: linkis-ps-publicservice
at org.apache.linkis.bml.common.HdfsResourceHelper.upload(HdfsResourceHelper.java:98) ~[linkis-bmlserver-1.3.1.jar:1.3.1]
......
Caused by: org.apache.hadoop.fs.ChecksumException: Checksum error: /tmp/linkis/ltz1/bml/20230223/013de473-cf31-4197-a012-e85a3e2f2d0f at 82836480
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.readChunk(ChecksumFileSystem.java:260) ~[hadoop-common-3.1.1.jar:?]
at org.apache.hadoop.fs.FSInputChecker.readChecksumChunk(FSInputChecker.java:300) ~[hadoop-common-3.1.1.jar:?]
at org.apache.hadoop.fs.FSInputChecker.read1(FSInputChecker.java:252) ~[hadoop-common-3.1.1.jar:?]
at org.apache.hadoop.fs.FSInputChecker.read(FSInputChecker.java:197) ~[hadoop-common-3.1.1.jar:?]
at java.io.DataInputStream.read(DataInputStream.java:100) ~[?:1.8.0_212]
at org.apache.linkis.bml.common.HdfsResourceHelper.upload(HdfsResourceHelper.java:92) ~[linkis-bmlserver-1.3.1.jar:1.3.1]
... 129 more
......
2023-02-23 21:33:54.341 [ERROR] [qtp1088034372-20 ] o.a.l.b.r.BmlRestfulApi (686) [uploadResource] - upload resource for user : ltz1 failed, reason: org.apache.linkis.bml.common.UploadResourceException: errCode: 60050 ,desc: The first upload of the resource failed(首次上传资源失败) ,ip: hadoop102 ,port: 9105 ,serviceKind: linkis-ps-publicservice
......
Caused by: org.apache.hadoop.fs.ChecksumException: Checksum error: /tmp/linkis/ltz1/bml/20230223/013de473-cf31-4197-a012-e85a3e2f2d0f at 82836480
......
Caused by: org.apache.hadoop.fs.ChecksumException: Checksum error: /tmp/linkis/ltz1/bml/20230223/013de473-cf31-4197-a012-e85a3e2f2d0f at 82836480
2023-02-23 21:33:54.343 [ERROR] [qtp1088034372-20 ] o.a.l.s.r.SpringRestfulCatchAOP (93) [apply] - error code(错误码): 60050, error message(错误信息): The first upload of the resource failed(首次上传资源失败). org.apache.linkis.common.exception.ErrorException: errCode: 50073 ,desc: The commit upload resource task failed(提交上传资源任务失败):errCode: 60050 ,desc: The first upload of the resource failed(首次上传资源失败) ,ip: hadoop102 ,port: 9105 ,serviceKind: linkis-ps-publicservice ,ip: hadoop102 ,port: 9105 ,serviceKind: linkis-ps-publicservice
````
linkis-cg-linkismanager.log:
````log
2023-02-23 21:33:54.365 [ERROR] [Linkis-Default-Scheduler-Thread-1 ] o.a.l.e.s.s.DefaultEngineConnResourceService (119) [apply] - Failed to upload engine conn to bml, now exit! org.apache.linkis.httpclient.exception.HttpClientResultException: errCode: 10905 ,desc: URL /api/rest_j/v1/bml/upload request failed! ResponseBody is {"method":null,"status":1,"message":"error code(错误码): 60050, error message(错误信息): The first upload of the resource failed(首次上传资源失败).","data":{"errorMsg":{"serviceKind":"linkis-ps-publicservice","level":2,"port":9105,"errCode":50073,"ip":"hadoop102","desc":"The commit upload resource task failed(提交上传资源任务失败):errCode: 60050 ,desc: The first upload of the resource failed(首次上传资源失败) ,ip: hadoop102 ,port: 9105 ,serviceKind: linkis-ps-publicservice"}}}. errCode: 10905 ,desc: URL /api/rest_j/v1/bml/upload request failed! ResponseBody is {"method":null,"status":1,"message":"error code(错误码): 60
050, error message(错误信息): The first upload of the resource failed(首次上传资源失败).","data":{"errorMsg":{"serviceKind":"linkis-ps-publicservice","level":2,"port":9105,"errCode":50073,"ip":"hadoop102","desc":"The commit upload resource task failed(提交上传资源任务失败):errCode: 60050 ,desc: The first upload of the resource failed(首次上传资源失败) ,ip: hadoop102 ,port: 9105 ,serviceKind: linkis-ps-publicservice"}}}. ,ip: hadoop102 ,port: 9101 ,serviceKind: linkis-cg-linkismanager ,ip: hadoop102 ,port: 9101 ,serviceKind: linkis-cg-linkismanager
at org.apache.linkis.httpclient.dws.response.DWSResult$$anonfun$set$2.apply(DWSResult.scala:85) ~[linkis-gateway-httpclient-support-1.3.1.jar:1.3.1]
````
<!-- 拖拽上传后，会自动生成如下示例格式的附
[linkis-cg-engineconnmanager.log](https://github.com/apache/linkis/files/10814331/linkis-cg-engineconnmanager.log)
[linkis-cg-engineconnmanager-gc.log](https://github.com/apache/linkis/files/10814332/linkis-cg-engineconnmanager-gc.log)
[linkis-cg-entrance.log](https://github.com/apache/linkis/files/10814333/linkis-cg-entrance.log)
[linkis-cg-entrance-gc.log](https://github.com/apache/linkis/files/10814334/linkis-cg-entrance-gc.log)
[linkis-cg-linkismanager.log](https://github.com/apache/linkis/files/10814336/linkis-cg-linkismanager.log)
[linkis-mg-eureka.log](https://github.com/apache/linkis/files/10814337/linkis-mg-eureka.log)
[linkis-mg-eureka-gc.log](https://github.com/apache/linkis/files/10814338/linkis-mg-eureka-gc.log)
[linkis-mg-gateway.log](https://github.com/apache/linkis/files/10814339/linkis-mg-gateway.log)
[linkis-mg-gateway-gc.log](https://github.com/apache/linkis/files/10814340/linkis-mg-gateway-gc.log)
[linkis-ps-publicservice.log](https://github.com/apache/linkis/files/10814341/linkis-ps-publicservice.log)
[linkis-ps-publicservice-gc.log](https://github.com/apache/linkis/files/10814342/linkis-ps-publicservice-gc.log)
件url -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [linkis] casionone commented on issue #4260: [Question]The first upload of the resource failed.
Posted by "casionone (via GitHub)" <gi...@apache.org>.
casionone commented on issue #4260:
URL: https://github.com/apache/linkis/issues/4260#issuecomment-1445278919
About ` org.apache.hadoop.fs.ChecksumException` can refer to https://stackoverflow.com/questions/15434709/checksum-exception-when-reading-from-or-copying-to-hdfs-in-apache-hadoop
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [linkis] Captain02 commented on issue #4260: [Question]The first upload of the resource failed.
Posted by "Captain02 (via GitHub)" <gi...@apache.org>.
Captain02 commented on issue #4260:
URL: https://github.com/apache/linkis/issues/4260#issuecomment-1453156997
> About ` org.apache.hadoop.fs.ChecksumException` can refer to https://stackoverflow.com/questions/15434709/checksum-exception-when-reading-from-or-copying-to-hdfs-in-apache-hadoop
After inspection, it was found that the location of the Hadoop configuration file was specified incorrectly. Although this question doesn't appear here, thank you for your answer.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [linkis] casionone closed issue #4260: [Question]The first upload of the resource failed.
Posted by "casionone (via GitHub)" <gi...@apache.org>.
casionone closed issue #4260: [Question]The first upload of the resource failed.
URL: https://github.com/apache/linkis/issues/4260
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [linkis] github-actions[bot] commented on issue #4260: [Question]The first upload of the resource failed.
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #4260:
URL: https://github.com/apache/linkis/issues/4260#issuecomment-1441880957
## :blush: Welcome to the Apache Linkis community!!
We are glad that you are contributing by opening this issue.
Please make sure to include all the relevant context.
We will be here shortly.
If you are interested in contributing to our website project, please let us know!
You can check out our contributing guide on
:point_right: [How to Participate in Project Contribution](https://linkis.apache.org/community/how-to-contribute).
### Community
|WeChat Assistant|WeChat Public Account|
|-|-|
|<img src="https://linkis.apache.org/Images/wedatasphere_contact_01.png" width="128"/>|<img src="https://linkis.apache.org/Images/gzh_01.png" width="128"/>|
### Mailing Lists
|Name|Description|Subscribe|Unsubscribe|Archive|
|:-----|:--------|:------|:-------|:-----|
| [dev@linkis.apache.org](mailto:dev@linkis.apache.org) | community activity information | [subscribe](mailto:dev-subscribe@linkis.apache.org) | [unsubscribe](mailto:dev-unsubscribe@linkis.apache.org) | [archive](http://mail-archives.apache.org/mod_mbox/linkis-dev) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org