Problem Statement

OpenDAL implements services with the following convention:

• backend.rs
  • Builder: Builds a service's config. For example, see S3's builder. Refer to the Configurator too.
  • Backend: References to the core module and implements the fundamental Access trait.
• core.rs: Contains code that directly interacts with cloud services, databases, and platforms.
• other code modules

Currently, some services only implement backend.rs (a lack of core.rs), primarily for historical reasons. The recommended approach is to refactor these services so that each has both backend.rs and core.rs. This new convention makes the code base easier to maintain, read, and contribute to, thereby benefiting OpenDAL’s overall development.

Tasks

• FTP refactor(ftp): restructure FtpBackend and introduce FtpCore #5949
• GridFS feat(gridfs): implement GridfsCore for GridFS service #5966
• HDFS @uruemu
• HDFS native
• HTTP refactor: Migrate http service to context based http client #5879
• IPFS refactor: Introduce IpfsCore for improved service structure #5950
• IPFS Mutable File System (IPMFS) refactor: Introduce IpmfsCore for improved service structure #5980
• OneDrive feat(services/onedrive): add signer to utilize the refresh token #5733
• SFTP refactor: Introduce SftpCore for improved service structure #5902
• VercelArtifacts refactor: Introduce VercelArtifactsCore for improved service structure #5873
• Web HDFS refactor: Migrate WebHDFS service to context based http client #5893

If you’re interested in tackling one of these services, feel free to comment on this issue and we’ll help get you started!