March 30, 2025: This Week in OpenDAL

["github-actions[bot] (via GitHub)" <gi...@apache.org>]

GitHub user github-actions[bot] created a discussion: March 30, 2025: This Week in OpenDAL

*This weekly update is generated by LLMs. You're welcome to join our [Discord](https://opendal.apache.org/discord/) for in-depth discussions.*

---

## Overall Activity Summary
The past week has seen significant activity in the Apache OpenDAL repository, with contributions spanning refactoring, feature additions, bug fixes, and documentation updates. Notable areas of focus include improving metrics layers, migrating services to context-based HTTP clients, and refining service structures for better maintainability. Contributors have actively engaged in discussions to address issues and propose enhancements.

---

## Key Ongoing Projects
- **Refactoring Services to Use `backend.rs` and `core.rs` Convention**:
  Progress continues on refactoring services to improve code organization. Recent updates include contributions from @miroim for WebHDFS (#5893) and SFTP (#5902).

- **Metrics Layer Enhancements**:
  Multiple PRs have been merged to polish IO metrics, including #5883 by @Xuanwo, which introduces new metrics like `operation_bytes_rate` and `operation_ttfb_seconds`.

- **Context-Based HTTP Client Migration**:
  Services such as HTTP (#5879 by @miroim), WebHDFS (#5893 by @miroim), and VercelArtifacts (#5877 by @miroim) have been migrated to use context-based HTTP clients, streamlining service interactions.

- **Cache Layer Implementation**:
  Initial work on a cache layer has begun with #5906 by @jorgehermo9, which is currently in draft status and seeking feedback.

---

## Priority Items
- **Cache Layer Feedback** (#5906 by @jorgehermo9): Contributors are encouraged to provide feedback on the draft implementation of the cache layer to refine its scope and functionality.
- **Bug Fix for GCS `delete_iter`** (#5897 by @wlinna): Address the issue where `delete_iter` fails with invalid UTF-8 sequences in Google Cloud Storage.
- **OSS Service Metadata Issue** (#5853 by @Ziy1-Tan): Resolve discrepancies in metadata returned by OSS append operations, which are causing test failures.

---

## Notable Discussions
- **Breakpoint Resume and Incremental Upload** (#5875 by @videni): Contributors discussed strategies for implementing advanced upload features, including breakpoint resume and incremental uploads.
- **Bumping MSRV to 1.80** (#5864 by @Xuanwo): A discussion on raising OpenDAL's minimum supported Rust version to 1.80 to leverage newer features.
- **OBS Service Metadata Handling** (#5853 by @Ziy1-Tan): Addressing issues with metadata returned during append operations in the OBS service.

---

## Emerging Trends
- **Focus on Metrics**: There is a strong emphasis on refining metrics layers to provide clearer insights for production use cases.
- **Service Refactoring**: Efforts to standardize service structures are gaining momentum, improving maintainability and readability.
- **Context-Based Design**: Migration to context-based HTTP clients is becoming a central theme, enabling more flexible and efficient service interactions.

---

## Good First Issues
- **Refactor Services to Use `backend.rs` and `core.rs` Convention** (#5702): This issue involves refactoring services to align with the new convention. It’s a great entry point for contributors interested in improving code organization.
- **Tracking Issues of RFC-5479: Context** (#5480): Contribute to implementing context-based design, a foundational change for OpenDAL.
- **Implement `Write Returns Metadata` for All Services** (#5693): Extend the feature across services by adding capabilities and extracting metadata from responses.

---

Thank you to all contributors for your hard work and dedication to improving Apache OpenDAL! 🚀

GitHub link: https://github.com/apache/opendal/discussions/5909

----
This is an automatically sent email for dev@opendal.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@opendal.apache.org