Re: Thoughts on Chatbots?
Posted: Wed Nov 11, 2026 8:52 pm
I'll add that I've rarely gone past the double digits of messages in chats on Janitor AI, but that signing up for a (paid) API key from another LLM provider and adding as a proxy fixes (to a degree) issues with memory context and coherence.
This is an issue with all LLMs that's especially more prevalent with free tiers since memory is constrained by the computing power allocated.
If a chat bot isn't designed well this is probably just more noticeable earlier in a chat.
The creativity of a bot is also constrained by what a user types.
You can also obviously, or maybe it's not obvious, nudge / direct most bots by spelling out their actions or responses to send them in a certain direction.
This thread has more info:
https://www.reddit.com/r/JanitorAI_Offi ... ?rdt=49893
This is an issue with all LLMs that's especially more prevalent with free tiers since memory is constrained by the computing power allocated.
If a chat bot isn't designed well this is probably just more noticeable earlier in a chat.
The creativity of a bot is also constrained by what a user types.
You can also obviously, or maybe it's not obvious, nudge / direct most bots by spelling out their actions or responses to send them in a certain direction.
This thread has more info:
https://www.reddit.com/r/JanitorAI_Offi ... ?rdt=49893