this post was submitted on 03 Jun 2024
97 points (100.0% liked)
chapotraphouse
13473 readers
1 users here now
Banned? DM Wmill to appeal.
No anti-nautilism posts. See: Eco-fascism Primer
Vaush posts go in the_dunk_tank
Dunk posts in general go in the_dunk_tank, not here
Don't post low-hanging fruit here after it gets removed from the_dunk_tank
founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
LLMs in general have a context window length. While the platform likely appends some meta/summary in it. The AI at most only remembers what he said a few hundred lines ago.
Dementia spouse simulator
Very true, but I'd have thought that most LLMs, especially those trying to be a relationship bot, should be doing some smart trickery to summarise SOME kind of total history into the context window.
There's vector based databases that insert relevant info in to the context window. Idk how this one in particular works though.