Git worked until we hit a few gigabytes. S3 scales super well but version control, documentation, and change management isn't great (we just did lots of "v1" or "vsep28_2023" names).
DVC felt very clunky (now I need git AND s3 AND dvc) by the team.
What best practices and patterns have you seen work or have you implemented yourself?
Website: https://oxen.ai
Dev Docs: https://docs.oxen.ai
GitHub: https://github.com/Oxen-AI/oxen-release
Feel free to reach out on the repo issues if you run into anything!