Thats interesting. When I did play with it a bit, it wasn't clear to me if it was actually doing that, but in hindsight it definitely was and was not just a coincidence. When I first used ChatGPT, I had a dog that recently passed, and she had such a big personality (a mischievous always hungry hunting dog) and was just very different than my other dog (a pitbull mix that likes to guard things), and I had thought that the two of them would be a good basis for a children's book.
I initially put in a prompt like "tell me a story about the hunting dog and the guard dog." and the results were pretty meh. I was interested to see if it was actually pulling in data from FB so I put her name in instead (she had an FB page yes). It did not seem to do much. So I put in some things like "the little hunting dog is always hungry." "the hunting dog is always looking to hunt" and then did a fuller prompt of "the hunting dog and the guard dog are going to the park. tell me a story about it" and finally got a very good fully fleshed out story about how the little dog was on the prowl for a squirrel while the guard dog watched out and it was really well written and made about as much sense as a fictional tale could. There was no awkwardness or other tells that would have made you think that this was written by anything other than a human.
Anyway, that is huge that it can do this. I do remember when I used to play with other chatbots that remembering past context was something they were unable to do, at least not well, but in most cases it seems they didn't even attempt to. ChatGPT has blown me away in many ways, but this is a very specific leap forward.
It usually always comes up with something very meh the first time around. You have to nudge it in the right direction.
I was showing it off to my wife. I asked it to write a lecture for an intro to Latin American poetry with a focus on Pablo Neruda, including a background on Chilean history.
The first result was just 5-6 paragraphs with the most rudimentary 101 on all the above topics.
Then I told it to rewrite it as if the lecture was going to be given to grad students. Next, I told it to include examples of Neruda's poetry along with some analysis. I also asked it to flesh out the segment on Chilean history, with a focus on the independence movement.
The final lecture was good enough that you could walk into a classroom of college seniors and deliver it without any edits. The first one might have been good enough for 9th graders at most.
I initially put in a prompt like "tell me a story about the hunting dog and the guard dog." and the results were pretty meh. I was interested to see if it was actually pulling in data from FB so I put her name in instead (she had an FB page yes). It did not seem to do much. So I put in some things like "the little hunting dog is always hungry." "the hunting dog is always looking to hunt" and then did a fuller prompt of "the hunting dog and the guard dog are going to the park. tell me a story about it" and finally got a very good fully fleshed out story about how the little dog was on the prowl for a squirrel while the guard dog watched out and it was really well written and made about as much sense as a fictional tale could. There was no awkwardness or other tells that would have made you think that this was written by anything other than a human.
Anyway, that is huge that it can do this. I do remember when I used to play with other chatbots that remembering past context was something they were unable to do, at least not well, but in most cases it seems they didn't even attempt to. ChatGPT has blown me away in many ways, but this is a very specific leap forward.