It's been a few weeks ago, but I recall asking ChatGPT about models in Django, which on the surface it often gets perfect.
However, when I asked that the model in question needs to be unmanaged and backed by a SQL view (which I pasted), which had previously been applied from a migration script, it became pretty obvious that ChatGPT is just putting together sentences that are highly likely to be true, but not really understanding the architecture of Django.
So that's one example - and it's not even a particularly complex scenario.
I've been using version 4 for Django quite a bit and it has saved me quite a bit of coding. I'll just throw in my model and explain in detail what views and serializers to write and the code is near perfect. I didn't have that same experience with GPT 3.5.
And wow, is it convenient for writing tests. I just copy the entire views.py in and list all of the tests I want. The key is to be explicit with what you want.
try asking phind.com, if it brings up outdated info just give it a link to catch up on the latest stuff, it helped me grok next js server actions and convert some code to use server actions over api calls.
