This is a really cool step but as someone without the suggested GPU, it isn't easy or one click for me yet.
I am hoping that someone makes a very simple Jupyter notebook where I can enter my RLHF file and select a few other settings and just run (on AWS or Azure; willing to pay per fine-tuned model say $100-$500 for cloud credits + notebook access).
In case anyone else is curious, this yt video helps me understand how Azure ML works and I think with this understanding, combined with the Github read me, it will be doable. https://www.youtube.com/watch?v=yBVXR8G8Bg8
I am hoping that someone makes a very simple Jupyter notebook where I can enter my RLHF file and select a few other settings and just run (on AWS or Azure; willing to pay per fine-tuned model say $100-$500 for cloud credits + notebook access).