You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hugegraph.apache.org by "z7658329 (via GitHub)" <gi...@apache.org> on 2024/04/12 03:41:59 UTC
[I] [Question] i have deploy hugegraph server( singel node), write occur error: org.apache.hugegraph.exception.ServerException: The rest server is too busy to write [incubator-hugegraph]
z7658329 opened a new issue, #2517:
URL: https://github.com/apache/incubator-hugegraph/issues/2517
### Problem Type (问题类型)
None
### Before submit
- [X] 我已经确认现有的 [Issues](https://github.com/apache/hugegraph/issues) 与 [FAQ](https://hugegraph.apache.org/docs/guides/faq/) 中没有相同 / 重复问题 (I have confirmed and searched that there are no similar problems in the historical issue and documents)
### Environment (环境信息)
- Server Version: 1.2.0 (Apache Release Version)
- Backend: RocksDB 1 nodes, HDD
- OS: 16 CPUs, 32 G RAM, Ubuntu 1.6.0
- Data Size: 500W vertices, 1000W edges
### Your Question (问题描述)
1. i have deploy hugegraph server( singel node)， use rocksdb store, i want to benchmark my huge server, but write error, my
config:
backend=rocksdb
serializer=binary
store=hugegraph
raft.mode=false
raft.path=./raft-log
raft.safe_read=true
### Vertex/Edge example (问题点 / 边数据举例)
_No response_
### Schema [VertexLabel, EdgeLabel, IndexLabel] (元数据结构)
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@hugegraph.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Question] i have deploy hugegraph server( singel node), write occur error: org.apache.hugegraph.exception.ServerException: The rest server is too busy to write [incubator-hugegraph]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #2517: [Question] i have deploy hugegraph server( singel node), write occur error: org.apache.hugegraph.exception.ServerException: The rest server is too busy to write
URL: https://github.com/apache/incubator-hugegraph/issues/2517
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Question] i have deploy hugegraph server( singel node), write occur error: org.apache.hugegraph.exception.ServerException: The rest server is too busy to write [incubator-hugegraph]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #2517:
URL: https://github.com/apache/incubator-hugegraph/issues/2517#issuecomment-2081182159
Due to the lack of activity, the current issue is marked as stale and will be closed after 20 days, any update will remove the stale label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org
Re: [I] [Question] i have deploy hugegraph server( singel node), write occur error: org.apache.hugegraph.exception.ServerException: The rest server is too busy to write [incubator-hugegraph]
Posted by "imbajin (via GitHub)" <gi...@apache.org>.
imbajin commented on issue #2517:
URL: https://github.com/apache/incubator-hugegraph/issues/2517#issuecomment-2051245073
@dosu-bot could u help to find the relative context/issues & give some suggestion?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org
Re: [I] [Question] i have deploy hugegraph server( singel node), write occur error: org.apache.hugegraph.exception.ServerException: The rest server is too busy to write [incubator-hugegraph]
Posted by "dosubot[bot] (via GitHub)" <gi...@apache.org>.
dosubot[bot] commented on issue #2517:
URL: https://github.com/apache/incubator-hugegraph/issues/2517#issuecomment-2051258301
<!-- Answer -->
The error you're encountering, `org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: The rest server is too busy to write`, suggests that the HugeGraph server is experiencing high load, which is impacting its ability to process write requests efficiently. Here are targeted suggestions to address this issue:
1. **Optimize HugeGraph and RocksDB Configurations**: Adjust RocksDB settings like `max_background_jobs`, `write_buffer_size`, and `max_open_files` to better match your hardware capabilities, potentially improving performance under load.
2. **Increase Iterator Pool Capacity**: The error might be related to the capacity of the iterator pool. Increasing the `ITERATOR_POOL_CAPACITY` in `RocksDBIteratorPool.java` could help manage load more effectively by allowing more iterators to be pooled concurrently.
3. **Enable Iterator Reusing**: In `ReusedRocksIterator.java`, changing `REUSING_ENABLED` from `false` to `true` can reduce the overhead associated with iterator creation and destruction, which is beneficial under high load scenarios.
4. **Benchmark Code Optimization**: Review your benchmarking approach to ensure it doesn't overwhelm the server. Adjusting the rate of requests or the level of concurrency might prevent the server from becoming too busy to write.
5. **Server Performance Monitoring**: Utilize monitoring tools to identify performance bottlenecks. This can guide further optimizations, whether in configuration or hardware adjustments.
6. **Update HugeGraph and RocksDB**: Ensure you're using the latest versions as they may include relevant performance improvements or bug fixes.
For specific RocksDB configurations:
- `max_background_jobs`: Consider setting this to a higher value to allow more concurrent background processes.
- `write_buffer_size`: Increasing this can help manage write workload spikes more effectively.
- `max_open_files`: Setting this to `-1` or a high number can reduce file operation overhead, aiding in performance under heavy load.
These adjustments are starting points. Monitoring and iterative tuning based on actual performance are crucial for achieving optimal configurations.
## Sources
- [hugegraph-server/hugegraph-rocksdb/src/main/java/org/apache/hugegraph/backend/store/rocksdb/RocksDBIteratorPool.java](https://github.com/apache/incubator-hugegraph/blob/master/hugegraph-server/hugegraph-rocksdb/src/main/java/org/apache/hugegraph/backend/store/rocksdb/RocksDBIteratorPool.java)
- [hugegraph-server/hugegraph-rocksdb/src/main/java/org/apache/hugegraph/backend/store/rocksdb/RocksDBOptions.java](https://github.com/apache/incubator-hugegraph/blob/master/hugegraph-server/hugegraph-rocksdb/src/main/java/org/apache/hugegraph/backend/store/rocksdb/RocksDBOptions.java)
<!-- Dosu Comment Footer -->
<details>
<summary>
#### About Dosu
</summary>
This response is meant to be useful and save you time. It is **not meant to be a precise solution**, but rather a starting point for your own research.
Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.
If you want to continue the conversation, start your reply with @dosu-bot.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org