Add native support for monoio project

[Xuanwo]

Apply for this project: https://summer-ospp.ac.cn/org/prodetail/241110346

Goal

Add monoio based fs support as mentioned in #4520.

The usage will look like:

let op = Operator::via_map(Scheme::MonoioFs, map)?;
let bs = op.read("path/to/file").await?;

Requirement

• Know about monoio
• Know about how to build/test rust project
• Better to have some knowledge about io-uring
• The current fs API in monoio is incomplete; we may need to collaborate with upstream to finalize them.

Mentorship

Mentor: @Xuanwo
Discussion: mailing list and discord

[hoslo]

@Xuanwo I'm interested in this.

[Xuanwo]

@Xuanwo I'm interested in this.

Thank you for your interest. However, this project is designated as an OSPP project; perhaps you would like to participate as a mentor instead?

[hoslo]

@Xuanwo I'm interested in this.

Thank you for your interest. However, this project is designated as an OSPP project; perhaps you would like to participate as a mentor instead?

I just noticed this, you are better as a mentor, I can go and solve other issues.

[NKID00]

Task list to track progress of monoiofs

• init monoiofs service, introduce feature flag and dep (feat(services): init monoiofs #4855)
• monoio runtime wrapper, thread management and operation dispatch (feat(services/monoiofs): monoio wrapper #4885)
• open, read, write, stat & delete (feat(services/monoiofs): impl read and write, add behavior test #4944)
• behavior tests (feat(services/monoiofs): impl read and write, add behavior test #4944)
• append, create_dir, rename & copy (feat(services/monoiofs): append, create_dir, copy and rename #5041)
• benchmarks (feat(core/bench): add fs, monoiofs and compfs benchmark #5095)

Blocked by monoio

• vectored io (Vectored IO for files bytedance/monoio#266)

[Xuanwo]

Hi, @NKID00, are you interested in getting some benchmark data about fs and monoiofs?

[NKID00]

Hi, @NKID00, are you interested in getting some benchmark data about fs and monoiofs?

I've measured some data while writing the final report of the OSPP project. You can find the raw data in #5095 and there was a chart in the report. I can repost it here:

These data may be a bit out dated, though.

[Xuanwo]

Cool!