Long term and short term memory

A demo of a Gradio interface using ChromaDB to store and retrieve conversation embeddings, enabling long‑term memory with OpenAI API integration and feedback loops.

Overview

Wrote a quick gradio script to use chromadb to act as a long term memory of past conversations. Still a wip, but it works and would like to share it with others.

The tool mimics anything-llm but in 250 lines of code.

I intend on having web search functionality built in.

Basically swap in any openai compatible api endpoint (use text-generation-webui) and you’re golden.

For the demo, I plan on using openai’s endpoint.

Links

https://gist.github.com/thistleknot/9ad1882ddb0987b96b5745c49d38516b
Gradio RAG client integrates web search, ChromaDB, and local LLM.

Tech stack