On our site, Memories have been amongst the most debated subjects, and the systems subjected to the most change overall. What is a roleplay site without good memory, and what kinda world-building would survive without it? Well, MiocAI doesnt have to.

In this article we are getting into the juicy details of how our memories work, how effective they are, and more. Like, subscribe, ring the bell, yada-yada.

How are memories generated?

Long-term Memories, by default, generate for every 10 messages automatically, taking the context, prose, actions, direction etc and compiling them into a small memory document. They appear in the interface as such:

In the past, before we cared too much about performance, long-term memories used to be generated exactly with each 10th message. The advantage there was of course that you could immediately see the memory for the current message block. Logically though, it didnt make a lot of sense. Even if the memory is generated immediately with every block, the block it summarized would already be in the short term memory, hence adding no real benefit but blocking the text generation pipeline for a few seconds for each memory.

Now we still generate them for each 10th message, just a bit later in the background. The added benifit is faster replies, and getting memories only when you actually need them, hence clearing up a lot of the context.

What are all the toggles for?

Okay, I may be exaggerating the extent of toggles you can play with for memories. Alas, they have their nuances.

The first is relatively self-explainatory. If you disable long term memories, long term memories stop being generated. Duh.