You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hugegraph.apache.org by "hexuxu110 (via GitHub)" <gi...@apache.org> on 2025/01/13 13:09:02 UTC
[I] [Question] describe your problem [incubator-hugegraph]
hexuxu110 opened a new issue, #2721:
URL: https://github.com/apache/incubator-hugegraph/issues/2721
### Problem Type (问题类型)
None
### Before submit
- [x] 我已经确认现有的 [Issues](https://github.com/apache/hugegraph/issues) 与 [FAQ](https://hugegraph.apache.org/docs/guides/faq/) 中没有相同 / 重复问题 (I have confirmed and searched that there are no similar problems in the historical issue and documents)
### Environment (环境信息)
- Server Version: 1.0.0 (Apache Release Version)
- Backend: RocksDB
- OS: 64CPU 128Gmemory
- Data Size: xx vertices, xx edges <!-- (like 30亿 点, 30亿 边) -->
### Your Question (问题描述)
**第一台机器:**
du -sh *
817G raft-log
1.3T rocksdb_data
0 rocksdb_log
find G -type f | wc -l
2w个sst文件
**第二台机器:**
732G raft-log
764G rocksdb_data
0 rocksdb_log
find G -type f | wc -l
1w个sst文件
我的是一主6从部署，为什么2个从服务器的占用磁盘大小不一致
### Vertex/Edge example (问题点 / 边数据举例)
```javascript
```
### Schema [VertexLabel, EdgeLabel, IndexLabel] (元数据结构)
```javascript
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@hugegraph.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] rocksdb 2台从服务器的sst文件区别很大 [incubator-hugegraph]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #2721:
URL: https://github.com/apache/incubator-hugegraph/issues/2721#issuecomment-2628394891
Due to the lack of activity, the current issue is marked as stale and will be closed after 20 days, any update will remove the stale label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org
Re: [I] [Question] describe your problem [incubator-hugegraph]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
dosubot[bot] commented on issue #2721:
URL: https://github.com/apache/incubator-hugegraph/issues/2721#issuecomment-2589232373
<!-- Answer -->
你能提供更多关于你的部署和配置的信息吗？例如，数据分片策略、复制因子、以及是否有任何自定义的配置参数。这些信息可能有助于更好地理解为什么两个从服务器的磁盘使用情况不同。
<!-- Dosu Comment Footer -->
*To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
---
<sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=hallucination) | [Other](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=other)</sup>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org
Re: [I] rocksdb 2台从服务器的sst文件区别很大 [incubator-hugegraph]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #2721: rocksdb 2台从服务器的sst文件区别很大
URL: https://github.com/apache/incubator-hugegraph/issues/2721
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] rocksdb 2台从服务器的sst文件区别很大 [incubator-hugegraph]
Posted by "imbajin (via GitHub)" <gi...@apache.org>.
imbajin commented on issue #2721:
URL: https://github.com/apache/incubator-hugegraph/issues/2721#issuecomment-2594645725
> > 你能提供更多关于你的部署和配置的信息吗？例如，数据分片策略、复制因子、以及是否有任何自定义的配置参数。这些信息可能有助于更好地理解为什么两个从服务器的磁盘使用情况不同。
> > _To continue talking to [Dosu](https://dosu.dev), mention [@dosu](https://github.com/dosu)._
> > Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=hallucination) | [Other](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=other)
>
> 2台机器都是这个配置,大部分都是1.0.0项目rocskdb默认配置
>
> # gremlin entrance to create graph
> # auth config: org.apache.hugegraph.auth.HugeFactoryAuthProxy
> gremlin.graph=org.apache.hugegraph.HugeFactory
>
> # cache config
> #schema.cache_capacity=100000
> # vertex-cache default is 1000w, 10min expired
> vertex.cache_type=l2
> vertex.cache_capacity=0
> #vertex.cache_expire=600
> # edge-cache default is 100w, 10min expired
> edge.cache_type=l2
> edge.cache_capacity=0
> #edge.cache_expire=600
>
>
> # schema illegal name template
> #schema.illegal_name_regex=\s+|~.*
>
> #vertex.default_label=vertex
>
> backend=rocksdb
> serializer=binary
>
> store=octo_rocksdb
>
> raft.mode=true
> raft.path=/home/*/data1/octo-graph/raft-log
> raft.safe_read=false
> raft.use_replicator_pipeline=true
> raft.election_timeout=10000
> raft.snapshot_interval=21600
> raft.backend_threads=48
> raft.read_index_threads=8
> raft.snapshot_threads=4
> raft.snapshot_parallel_compress=true
> raft.snapshot_compress_threads=16
> raft.snapshot_decompress_threads=16
> raft.read_strategy=ReadOnlyLeaseBased
> raft.queue_size=16384
> raft.queue_publish_timeout=60
> raft.apply_batch=1
> raft.rpc_threads=80
> raft.rpc_connect_timeout=5000
> raft.rpc_timeout=60
> raft.install_snapshot_rpc_timeout=36000
>
> search.text_analyzer=jieba
> search.text_analyzer_mode=INDEX
>
> # rocksdb backend config
> rocksdb.data_path=/home/*/data1/octo-graph/rocksdb_data
> rocksdb.wal_path=/home/*/data1/octo-graph/rocksdb_log
> [<img alt="" width="16" height="16" src="https://avatars.githubusercontent.com/dosu?size=32">@dosu](https://github.com/dosu)
@dosu based on the context that user provided, give suggestion as much as possible
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org
Re: [I] [Question] describe your problem [incubator-hugegraph]
Posted by "imbajin (via GitHub)" <gi...@apache.org>.
imbajin commented on issue #2721:
URL: https://github.com/apache/incubator-hugegraph/issues/2721#issuecomment-2589147439
what's your HG version?
Try to use 1.5.0+ for the community support, the previous multi-replica version has been archived and is no longer being maintained 🔢
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org
Re: [I] [Question] describe your problem [incubator-hugegraph]
Posted by "imbajin (via GitHub)" <gi...@apache.org>.
imbajin commented on issue #2721:
URL: https://github.com/apache/incubator-hugegraph/issues/2721#issuecomment-2589229387
> > what's your HG version?
> > Try to use 1.5.0+ for the community support, the previous multi-replica version has been archived and is no longer being maintained 🔢
>
> i'm using 1.0.0 version of hugegraph. who is put like this issue before?
@dosu could you help the user to provide ways and methods for locating problems
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org
Re: [I] rocksdb 2台从服务器的sst文件区别很大 [incubator-hugegraph]
Posted by "hexuxu110 (via GitHub)" <gi...@apache.org>.
hexuxu110 commented on issue #2721:
URL: https://github.com/apache/incubator-hugegraph/issues/2721#issuecomment-2591906767
> 你能提供更多关于你的部署和配置的信息吗？例如，数据分片策略、复制因子、以及是否有任何自定义的配置参数。这些信息可能有助于更好地理解为什么两个从服务器的磁盘使用情况不同。
>
> _To continue talking to [Dosu](https://dosu.dev), mention [@dosu](https://github.com/dosu)._
>
> Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=hallucination) | [Other](https://app.dosu.dev/response-feedback/f1b14b2d-15bb-4db8-bf5b-33d5e9b482a8?feedback_type=other)
2台机器都是这个配置,大部分都是1.0.0项目rocskdb默认配置
# gremlin entrance to create graph
# auth config: org.apache.hugegraph.auth.HugeFactoryAuthProxy
gremlin.graph=org.apache.hugegraph.HugeFactory
# cache config
#schema.cache_capacity=100000
# vertex-cache default is 1000w, 10min expired
vertex.cache_type=l2
vertex.cache_capacity=0
#vertex.cache_expire=600
# edge-cache default is 100w, 10min expired
edge.cache_type=l2
edge.cache_capacity=0
#edge.cache_expire=600
# schema illegal name template
#schema.illegal_name_regex=\s+|~.*
#vertex.default_label=vertex
backend=rocksdb
serializer=binary
store=octo_rocksdb
raft.mode=true
raft.path=/home/xiaoju/data1/octo-graph/raft-log
raft.safe_read=false
raft.use_replicator_pipeline=true
raft.election_timeout=10000
raft.snapshot_interval=21600
raft.backend_threads=48
raft.read_index_threads=8
raft.snapshot_threads=4
raft.snapshot_parallel_compress=true
raft.snapshot_compress_threads=16
raft.snapshot_decompress_threads=16
raft.read_strategy=ReadOnlyLeaseBased
raft.queue_size=16384
raft.queue_publish_timeout=60
raft.apply_batch=1
raft.rpc_threads=80
raft.rpc_connect_timeout=5000
raft.rpc_timeout=60
raft.install_snapshot_rpc_timeout=36000
search.text_analyzer=jieba
search.text_analyzer_mode=INDEX
# rocksdb backend config
rocksdb.data_path=/home/xiaoju/data1/octo-graph/rocksdb_data
rocksdb.wal_path=/home/xiaoju/data1/octo-graph/rocksdb_log
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org
Re: [I] [Question] describe your problem [incubator-hugegraph]
Posted by "hexuxu110 (via GitHub)" <gi...@apache.org>.
hexuxu110 commented on issue #2721:
URL: https://github.com/apache/incubator-hugegraph/issues/2721#issuecomment-2589220386
> what's your HG version?
>
> Try to use 1.5.0+ for the community support, the previous multi-replica version has been archived and is no longer being maintained 🔢
i'm using 1.0.0 version of hugegraph.
who is put like this issue before?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org
Re: [I] rocksdb 2台从服务器的sst文件区别很大 [incubator-hugegraph]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
dosubot[bot] commented on issue #2721:
URL: https://github.com/apache/incubator-hugegraph/issues/2721#issuecomment-2594649055
<!-- Answer -->
To address the discrepancy in SST file sizes and counts between your two RocksDB replica servers, consider the following suggestions:
1. **Check Data Consistency**: Ensure that both replicas have the same data. Differences in data can lead to variations in SST file sizes and counts. Use tools or scripts to verify data consistency across replicas.
2. **Review Compaction Settings**: Compaction settings can significantly affect SST file sizes. Ensure that both servers have identical compaction configurations. Check parameters like `rocksdb.compaction_style` and `rocksdb.level0_file_num_compaction_trigger`.
3. **Monitor Write Patterns**: Different write patterns can lead to variations in SST file creation. Monitor the write load on each server to ensure they are receiving similar workloads.
4. **Check for Disk Space Issues**: Ensure that there are no disk space constraints on either server that might affect RocksDB's ability to perform compactions effectively.
5. **Review Raft Configuration**: Since you are using Raft, ensure that the Raft configuration is consistent across all nodes. Parameters like `raft.snapshot_interval` and `raft.backend_threads` can impact how data is replicated and stored.
6. **Examine Logs for Errors**: Check the logs on both servers for any errors or warnings that might indicate issues with data replication or compaction processes.
7. **Upgrade Consideration**: If possible, consider upgrading to a newer version of HugeGraph, as improvements and bug fixes in later versions might address some of these issues.
By following these steps, you should be able to identify and resolve the discrepancies in SST file sizes and counts between your RocksDB replica servers.
<!-- Dosu Comment Footer -->
*To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
---
<sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/18ad2eca-34c1-4678-b1a1-e1d547772c9f?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/18ad2eca-34c1-4678-b1a1-e1d547772c9f?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/18ad2eca-34c1-4678-b1a1-e1d547772c9f?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/18ad2eca-34c1-4678-b1a1-e1d547772c9f?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/18ad2eca-34c1-4678-b1a1-e1d547772c9f?feedback_type=hallucination) | [Other](https://app.dosu.dev/response-feedback/18ad2eca-34c1-4678-b1a1-e1d547772c9f?feedback_type=other)</sup>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org