Ceph setup has a few magic moments, but after you accept and learn those incantation, it just works! Highly recommend. Used to be easy to get started with their all-in-one container image.