chamelon

Subset of littlefs filesystem fulfilling MirageOS KV
README

An implementation of the mirage-kv module type offering persistence via mirage-block, suitable for use in MirageOS unikernels. It is inspired by littlefs.

what isn't this?

Performant. Wear-alert. Making big promises. Well-tested. Backed by Big Camel or suitable for Big Data.

under what circumstances should I definitely not use it?

See "how does it differ from littlefs?" for specific caveats of this implementation compared to other users of littlefs.

This implementation is not suitable for use as a large filesystem. Addressing is limited to 32-bit block indices, and currently the solo5 implementation supports blocks of a maximum size of 512 bytes, for a maximum addressible filesystem of 65535 MiB. Block devices of larger size can be supplied, but only 64 GiB will be usable by chamelon.

littlefs is most efficient in its space usage with many small ( < 1/4 block size) files in a broad hierarchy (i.e. most directories have many files or other directories in them).

It is least space-efficient with many files of size > 1/4 block size and < 1 block size, and with deeply-nested directory structures.

The above limitations become more alarming with the knowledge that items within a directory are an unordered linked list, so many operations on directories are O(n) in the number of items within the directory. If performance begins to be of concern, some thought on the filesystem layout is advised.

why though?

Sometimes you just gotta store some stuff. You don't have to store much stuff and you don't have to do it very often but people are gonna get real mad if you don't do it at least a little.

can I use it?

Sure, if you want. chamelon is released under the ISC license (like many MirageOS libraries and its core tooling). Prospective users are encouraged to remember that THE SOFTWARE IS PROVIDED "AS IS" AND THE AUTHOR DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE.

why would I use it over other MirageOS filesystem implementations?

Good question. I'm using it because I didn't want to end up using an unmaintained filesystem implementation or maintaining someone else's filesystem implementation. Obviously that's not going to apply to you (or if it does, you're unlikely to decide this software is the right choice).

how does it differ from littlefs?

littlefs threads a linked list through its directory tree so the tree can be traversed in constant RAM. This necessitates some extra complexity to ensure that the tree and linked list agree. This implementation does not guarantee constant RAM operations, therefore does not use the threaded linked list (softlinks in the parlance of the littlefs spec), therefore also does not implement global move state.

littlefs implements wear leveling strategies aimed at increasing the life of flash-based storage. This implementation does not, because we assume the execution environment does not provide direct access to real storage; we trust the hypervisor's disk driver to handle this if it's appropriate and required.

This implementation also does not detect or track bad blocks, for similar reasons. (This decision would be fairly easy to reverse.)

The fuse driver for littlefs is interoperable with this implementation, to the best of my knowledge.

how do I thank you for writing and maintaining this software?

Directly with money, by donating to a 501c3 that does important work in my community, or by writing a nice e-mail to the address in the commit messages.

Install
Published
24 Jun 2022
Sources
chamelon-v0.0.9.1.tbz
sha256=14c8e64ce48dbfc09876a1a66351e44ce41669b87a0cc7c900a1cadc563d9bad
sha512=8988a0f03b1b0f89fee68a3950710705f1053536c24cde3dbb8916a2f0a90ce72eb97cacd400101f715a240dae6596f1fa598ec38bf30069be7d159a7f960653
Dependencies
optint
>= "0.0.4"
mirage-logs
>= "1.2.0"
mirage-kv
>= "4.0.1"
mirage-clock
>= "2.0.0"
mirage-block
>= "3.0.0"
ptime
>= "0.8.6"
lwt
>= "5.3.0"
logs
>= "0.6.0"
fmt
>= "0.8.7"
digestif
>= "1.0.0"
cstruct
>= "6.0.0"
checkseum
>= "0.3.2"
bechamel-js
>= "0.2.0" & with-test
bechamel
>= "0.2.0" & with-test
mirage-crypto-rng
>= "0.10.6" & with-test
mirage-block-unix
>= "2.13.0" & with-test
alcotest-lwt
>= "1.5.0" & with-test
alcotest
>= "1.5.0" & with-test
fpath
>= "0.7.3" & with-test
crowbar
>= "0.2.1" & with-test
chamelon-unix
= version & with-test
dune
>= "2.9.0"
ocaml
>= "4.10.0"
Reverse Dependencies
chamelon-unix
= "0.0.9.1"