I’m sitting in Udine, Italy after a day with the Cloudweavers team and trying to collect my first impressions.
In case you missed out about it, Cloudweavers is a ready-to-use private cloud “system”.
It can scale from one hypervisor host to many, meaning you can gracefully virtualize your whole infrastructure.
OpenNebula is used as the management stack because of it’s small footprint and easy customization.
Under this there’s a distributed filesystem. It’s not Ceph but one of the more mature ones (moosefs), meaning it would less successfully scale to 1000 hosts, but instead the POSIX FS semantics already work well and you can actually expect it to have the data accessible at all times 🙂
At a 1000 host scale I also have felt a certain pain with just having one large RADOS cluster, I’d segregate to more islands as to avoid large-scale losses. Carlo from Cloudweavers told me about ideas that are more along this line.
The cool part with cloudweavers is that you can bring up a setup on one node (in minutes) and really scale out from there, simply adding hosts as you need them. They then become hypervisor nodes and storage nodes. Systems with an older CPU or broken BIOS that can’t run KVM? Well, they’ll just be a storage node. Automagically 🙂
The part that makes me happy is that they have opted for resilience in all parts they touched.
Data is mirrored many times, writes are only committed if they’re successfully on another host and the whole architecture is made to be self-fencing and to recover gracefully.
I had originally inquired with them back in – I think – February looking at it from a cloud hosting angle since buying pre-integrated good software would run cheaper than home-building the full ceph/alpinelinux/xen/opennebula stack.
Now after having the first look, I think that was a good decision, even that very stack has matured a lot in the mean time.
I wanted to design a platform, and my goal was to have one that is truly resilient:
- It should be able to tolerate failures.
- It should be able to keep running for months even if I got hit by a bus.
Cloudweavers seems to have built it.