Local LLM Python Streamlit UI

From Chrysalis Archive
Jump to navigation Jump to search

an AI category

AI Engineering ∞  Notes on AI Machine Learning ☀  Notes on Self Hosting AI ☀  Hitchhiker's Guide to Local LLMs ☀  Notes on AI hardware vendors ☀  Local LLM Python Streamlit UI ☀  Graph Generalization using Functional Networks (GGUF) ☀  Compiling Python ☀  Steps to Build a Dialog-Wise Running AI RAG System ☀ 

Ollama v.x Streamlit Playground

This project demonstrates how to run and manage models locally using Ollama by creating an interactive UI with Streamlit.
 
The app has a page for running chat-based models and also one for nultimodal models (llava and bakllava) for vision.
 
App in Action
https://github.com/tonykipkemboi/ollama_streamlit_demos