Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I'm still new to LoRA/fine tunes, but: I can't just dump in 1gb of data, correct? I need to structure it in Question/Answer or the like?

So it would seem the cost really becomes converting/curating the data into a usable format first.



You can dump in 1gb of data (Unsloth supports "raw text training") but whether you'd get good results or a useless model is a different issue. I doubt you'd get a good result unless you combine that with question/answer training as well, assuming that feature is even useful at all for your scenario.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: