You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@horaedb.apache.org by "chunshao90 (via GitHub)" <gi...@apache.org> on 2023/12/29 03:19:30 UTC
[I] [DISCUSS]: Roadmap 2024 [incubator-horaedb]
chunshao90 opened a new issue, #1411:
URL: https://github.com/apache/incubator-horaedb/issues/1411
### Describe This Problem
Here are some of the features I have planned for 2024. Everyone is welcome to discuss.
### Proposal
### Distributed Solution
1. Meta Procedure Module
* Refine operations such as retries and rollbacks for different procedures.
2. Automated Load Balancing Based on Real Load
* Implement dynamic load information collection mechanisms, with horaedb uploading real load data.
* Incorporate advanced scheduling algorithms to balance load distribution based on actual load conditions.
3. Increase chaos testing to validate system robustness.
### Query Optimization
1. Optimize PQL by supporting operator pushdown to reduce data retrieval costs.
2. Add SST-level sorted keys to improve data-fetching efficiency during queries.
## Storage Optimization
1. Improve query performance for both high and low cardinality by enhancing storage formats
* Introduce inverted indexes.
* Organize data along timelines.
* Implement a columnar storage Memtable.
2. Compaction Offload
* Outsource compaction tasks to dedicated nodes or services to minimize the impact on real-time query nodes.
### Tools
1. horaecontrol cluster command-line tool, supporting functions such as automated deployment, monitoring integration, and fault diagnosis.
### Need to discuss
1. Evaluate the feasibility of reimplementing horaemeta with Rust to unify the development language and improve development efficiency.
### Additional Context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org
Re: [I] [DISCUSS]: Roadmap 2024 [incubator-horaedb]
Posted by "kcrazy (via GitHub)" <gi...@apache.org>.
kcrazy commented on issue #1411:
URL: https://github.com/apache/incubator-horaedb/issues/1411#issuecomment-2102159948
> > Support Windows system.
>
> Hi, would you give us more background about your user case?
>
> We haven't test horaedb on Windows since there is no one asking for this feature.
Although my production environment is Linux, my development and testing environments are on Windows.
Sometimes I also perform tasks on Windows.
If there is a native support version for Windows, it would be more convenient to use, and this is also a factor I consider in whether to use horaedb.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org
Re: [I] [DISCUSS]: Roadmap 2024 [incubator-horaedb]
Posted by "jiacai2050 (via GitHub)" <gi...@apache.org>.
jiacai2050 commented on issue #1411:
URL: https://github.com/apache/incubator-horaedb/issues/1411#issuecomment-2102111347
> Support Windows system.
Hi, would you give us more background about your user case?
We haven't test horaedb on Windows since there is no one asking for this feature.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org
Re: [I] [DISCUSS]: Roadmap 2024 [incubator-horaedb]
Posted by "kcrazy (via GitHub)" <gi...@apache.org>.
kcrazy commented on issue #1411:
URL: https://github.com/apache/incubator-horaedb/issues/1411#issuecomment-2102582290
> Thanks, that's sounds reasonable for me.
>
> In theory, IMO horaedb don't use any platform specific features, so it may work on Windows, but I can't ensure that, I think we need someone to try build/run on windows, would you like to give it a try? I create a tracking issue [here](https://github.com/apache/incubator-horaedb/issues/1527).
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org
Re: [I] [DISCUSS]: Roadmap 2024 [incubator-horaedb]
Posted by "jiacai2050 (via GitHub)" <gi...@apache.org>.
jiacai2050 commented on issue #1411:
URL: https://github.com/apache/incubator-horaedb/issues/1411#issuecomment-2102274062
Thanks, that's sounds reasonable for me.
In theory, IMO horaedb don't use any platform specific features, so it may work on Windows, but I can't ensure that, I think we need someone to try build/run on windows, would you like to give it a try? I create a tracking issue [here](https://github.com/apache/incubator-horaedb/issues/1527).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org
Re: [I] [DISCUSS]: Roadmap 2024 [horaedb]
Posted by "jiacai2050 (via GitHub)" <gi...@apache.org>.
jiacai2050 commented on issue #1411:
URL: https://github.com/apache/horaedb/issues/1411#issuecomment-2493018947
Closing since it's stale.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org
Re: [I] [DISCUSS]: Roadmap 2024 [incubator-horaedb]
Posted by "kcrazy (via GitHub)" <gi...@apache.org>.
kcrazy commented on issue #1411:
URL: https://github.com/apache/incubator-horaedb/issues/1411#issuecomment-2063199593
Support Windows system.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org
Re: [I] [DISCUSS]: Roadmap 2024 [incubator-horaedb]
Posted by "ShiKaiWi (via GitHub)" <gi...@apache.org>.
ShiKaiWi commented on issue #1411:
URL: https://github.com/apache/incubator-horaedb/issues/1411#issuecomment-1873575402
I guess Pre-Aggregation and Pre-Downsample is also an attractive feature to help improve the performance of the queries involving massive data points.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org
Re: [I] [DISCUSS]: Roadmap 2024 [incubator-horaedb]
Posted by "tanruixiang (via GitHub)" <gi...@apache.org>.
tanruixiang commented on issue #1411:
URL: https://github.com/apache/incubator-horaedb/issues/1411#issuecomment-1875074740
- import opendal
- code structure simplify
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org
Re: [I] [DISCUSS]: Roadmap 2024 [horaedb]
Posted by "jiacai2050 (via GitHub)" <gi...@apache.org>.
jiacai2050 closed issue #1411: [DISCUSS]: Roadmap 2024
URL: https://github.com/apache/horaedb/issues/1411
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org