Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
March 19, 2024
·
Los Angeles
LLM Long-Term Memory Demo
A demo of a Gradio interface using ChromaDB to store and retrieve conversation embeddings, enabling long‑term memory with OpenAI API integration and feedback loops.
Overview
Wrote a quick gradio script to use chromadb to act as a long term memory of past conversations. Still a wip, but it works and would like to share it with others.
The tool mimics anything-llm but in 250 lines of code.
I intend on having web search functionality built in.
Basically swap in any openai compatible api endpoint (use text-generation-webui) and you’re golden.
For the demo, I plan on using openai’s endpoint.
Links
Gradio RAG client integrates web search, ChromaDB, and local LLM.
Tech stack