You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@linkis.apache.org by GitBox <gi...@apache.org> on 2022/11/04 09:25:50 UTC
[GitHub] [incubator-linkis] guoshupei opened a new issue, #3742: [Bug] the method of `log` in Entrance can be lost log info
guoshupei opened a new issue, #3742:
URL: https://github.com/apache/incubator-linkis/issues/3742
### Search before asking
- [X] I searched the [issues](https://github.com/apache/incubator-linkis/issues) and found no similar issues.
### Linkis Component
linkis-computation-governance
### Steps to reproduce
If the script is executed for more than 5 minutes, and the log is actively added, the previous log will be lost.
### Expected behavior
Call the `log` method, we can get the log normally
### Your environment
<!-- Please describe the linkis version you are using and basic environment information -->
<!-- 请描述您使用的linkis版本和基本环境信息 -->
- Linkis version used: 1.1.1
### Anything else
More than 5 minutes, the `cachedLogs` will write to hdfs . And execute `fakeClear` method that it set all element to null, but not reset the Attributes of `flag`, `tail`, `realSize`, so when realLog, it still read log from `cachedLogs`, but it empty.
(默认超过5分钟,增加新日志会执行清除缓存并刷hdfs,但是清除缓存不会重置cachedLogs的`flag`, `tail`, `realSize`,所以当获取日志时,!sharedCache.cachedLogs.nonEmpty 不会为空,也就是不会从hdfs读取,还是从内存读取)


### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] peacewong commented on issue #3742: [Bug] the method of `log` in Entrance can be lost log info
Posted by GitBox <gi...@apache.org>.
peacewong commented on issue #3742:
URL: https://github.com/apache/incubator-linkis/issues/3742#issuecomment-1303163110
Hi guoshupei
RealSize records the true size after the first ring, and if you want to read data that is less than realSize fromLine<realSize, you read it from the file
flag is used in conjunction with realSize to get the real position of index, for example, when index=9 and maxCapacity=5
array(4) value stores 4 more
tail=0 The next data that can be inserted is 0
flag 1 realSize-flag is always a multiple of 5 and is used to get the true index
realSize 6
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] peacewong closed issue #3742: [Bug] the method of `log` in Entrance can be lost log info
Posted by GitBox <gi...@apache.org>.
peacewong closed issue #3742: [Bug] the method of `log` in Entrance can be lost log info
URL: https://github.com/apache/incubator-linkis/issues/3742
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] guoshupei commented on issue #3742: [Bug] the method of `log` in Entrance can be lost log info
Posted by GitBox <gi...@apache.org>.
guoshupei commented on issue #3742:
URL: https://github.com/apache/incubator-linkis/issues/3742#issuecomment-1296432762
How to understand the Attributes of `flag`, `realSize` in `org.apache.linkis.entrance.log.LoopArray` ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] github-actions[bot] commented on issue #3742: [Bug] the method of `log` in Entrance can be lost log info
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #3742:
URL: https://github.com/apache/incubator-linkis/issues/3742#issuecomment-1296430945
## :blush: Welcome to the Apache Linkis (incubating) community!!
We are glad that you are contributing by opening this issue.
Please make sure to include all the relevant context.
We will be here shortly.
If you are interested in contributing to our website project, please let us know!
You can check out our contributing guide on
:point_right: [How to Participate in Project Contribution](https://linkis.apache.org/community/how-to-contribute).
### Community
|WeChat Assistant|WeChat Public Account|
|-|-|
|<img src="https://linkis.apache.org/Images/wedatasphere_contact_01.png" width="128"/>|<img src="https://linkis.apache.org/Images/gzh_01.png" width="128"/>|
### Mailing Lists
|name|description|Subscribe|Unsubscribe|archive|
|:-----|:--------|:------|:-------|:-----|
| [dev@linkis.apache.org](mailto:dev@linkis.apache.org) | community activity information | [subscribe](mailto:dev-subscribe@linkis.apache.org) | [unsubscribe](mailto:dev-unsubscribe@linkis.apache.org) | [archive](http://mail-archives.apache.org/mod_mbox/linkis-dev) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
Re: [I] [Bug] the method of `log` in Entrance can be lost log info [linkis]
Posted by "YinDonglai (via GitHub)" <gi...@apache.org>.
YinDonglai commented on issue #3742:
URL: https://github.com/apache/linkis/issues/3742#issuecomment-2284733212
提供最新版DataSphereStudio全家桶安装服务。
包括(DataSphereStudio, Linkis, Exchangeis(Datax, Sqoop), Scriptis, Streamis(Flink), Visualis, DolphinScheduler)
1. 另外包含 元数据,数据安全,数据质量,数据血缘。(这些都是DataSphereStudio不自带的服务)
2. 包含hadoop集群搭建(hive, spark, flink, kafak, kylin)
3. 提供上述所有系统二次定制开发服务
4. 提供系统搭建运维疑难问题解决

添加备注,DSS大数据
持续为DataSphereStudio开源贡献力量
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org