I just got Oobabooga running for the first time with Llama-2, and have Automatic1111, and ComfyUI running for images. I am curious about ML too but I don’t know where this start with that one yet.
For the uninitiated, all of these tools are running offline open source (or mostly) models.
I think Silly Tavern + Silly Tavern Extras could achieve this, it uses ChromaDB for infinite context.
Interesting, I’ll take a look at this eventually.