Heh, played around a bit with ChatGPT. Neat little tool, but I don't see how people actually use this for anything serious like novel writing, given it's really shit at remembering details, which really would be of the few things I would actually expect an AI to be really good at.
Following up on this, AI LLMs like ChatGPT and GROK have something I'd describe as drop-off points. Because of the immense power requirements to run them, internal memory is severely limited, but w/regards to scope as well as duration of any kind of "conversation". After a certain threshold has been crossed, everything from early on in your conversation with the LLM will drop off a cliff, completely vanishing from the LLM's understanding and context of your convo. Which then leads to... interesting developments, given that the LLM will then try to re-contextualize the convo based on the info it has access to at that particular time... and again... and again.
Imagine someone forgetting the start of a conversation they are having with you, and then trying to continue and reframe your conversation without the earlier frame of reference, over and over again!
Case in point. My
I, Caesar Battletech fanfic sits at 140,000 words by now. So I thought, hey, why not use ChatGPT to keep track of characters, events, and plots? I had it summarize the chapters, track the characters and events. Worked fine until halfway through the current size of the fic. Then it started to forget what came before, and started making shit up.
The kicker is: it never tells you as much. It
never says: hey user, I've reached my capacity, whatever you add now will mean the earliest parts of our convo will be cut off.
Just let that sink in, and consider what this might mean for all those shmucks who use ChatGPT for some kind of scientific analysis or some such...