Skip to content

Curve Roadmap 2023 #2207

Open
Open
Curve Roadmap 2023#2207
Labels
featurenew featureroadmap
@ilixiaocui

Description

@ilixiaocui
ilixiaocui
opened on Jan 13, 2023

Update at 2023-07-24

CurveFS Feature

  • Performance
progress expected describe related
Doing Q3 Rename performance optimization pending (The design scheme has been confirmed, but there is a lack of developers to complete the function development. If you want to participate in the development of this function, please contact us)
Done Q2 Metadata performance optimization when multiple mounts enable cto consistency(In the cto consistency scenario, the client's metadata cache is invalid, resulting in slow metadata operations) Done in v2.6
  • Function
progress expected describe related
Doing Q2 Support CurveBS as data storage backend(In terms of function, the data deletion function needs to be completed. performance and stability need to be tested) pending (The development and basic testing of the single-client mounting mode has been completed in master branch, and the multi-client mounting mode still has data synchronization problems, If you want to participate in the development of this function, please contact us)
Doing Q3 Support HDFS SDK(hadoop users can use CurveFS as HDFS storage)
Delay NULL Support hot and cold data hierarchical storage and life cycle management Depending on the feature above
Doing Q3 Support online migration of a cluster across two IDCs(eg. MDS/ETCD/metaservers)
Q4 Support single replica storage backend (We can use various distributed kv cache systems to replace the S3 storage backend and implement a single copy mode to support temporary data storage services)
  • Scenes
progress expected describe related
Done Q2 Support AI scene(It is necessary to study the IO model of various stages of AI and perform targeted optimization) We have completed the docking and tuning of AI business scenarios in NetEase, and the performance and cost have achieved significant results. In the second half of the year, there will be specific output of relevant cases and optimization solutions, so stay tuned
Delay NULL Support hot data storage of ES\Clickhouse(Need to focus on performance optimization) Depending on the feature Support CurveBS as data storage backend

CurveBS Feature

  • Function
progress expected describe related
Done Q2 Integrate various tools of CurveBS into new tool https://github.com/opencurve/curve/tree/master/tools-v2
Done Q2 Compatible with librbd library interface, no need to compile QEMU and Libvirt when using Curve volume Basically completed, the beta version is expected to be released in early August
Done Q2 Hybrid storage engine supporting SSD/NVMe and HDD It has been used in NetEase, the beta version is expected to be released in early August
Done Q2 Supports single-cluster multi disk type storage pools, such as all-flash pools and HDD/SSD hybrid storage pools It has been used in NetEase, the beta version is expected to be released in early August
Delay NULL Support EC pending (The design scheme has been confirmed, but there is a lack of developers to complete the function development. If you want to participate in the development of this function, please contact us)
Delay NULL Support single machine scale in cluster pending (If you want to participate in the development of this function, please contact us)
Doing Q3 Support volume snapshot store in the CurveBS cluster Basically completed, the beta version is expected to be released in August
Doing Q3 Support authentication in Curve system Basically completed, the beta version is expected to be released in August
Doing Q3 Support online migration of a cluster across two IDCs(eg. MDS/ETCD/Chunkservers)
  • Performance
progress expected describe related
Doing Q3 Brpc/Braft optimization(Reduce software layer latency. Improve the stability of the cluster running under high load, for example, the heartbeat timeout caused by high load further leads to frequent switching of the replication group leader)
Doing Q3 Performance analysis and optimization in mixed flash scenarios(NVME+HDD)
Delay NULL Performance analysis tool
  • Deployment
progress expected describe related
Done Q2 curveadm support the client boots up and automatically mounts Done in v0.3

Cloud Native

progress expected describe related
Done Q2 Support CurveBS operator(Including cluster deployment, daily operation and maintenance, and visualization of monitoring indicators) https://github.com/opencurve/curve-operator
Done Q2 Support CurveFS operator(Including cluster deployment, daily operation and maintenance, and visualization of monitoring indicators) https://github.com/opencurve/curve-operator

CI

progress expected describe related
Done Q2 CI Stability Optimization of CurveBS We are using the new stability toolset now in CI
Q4 CI visualization optimization

Metadata

Metadata

Assignees

No one assigned

    Labels

    featurenew featureroadmap

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions